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ABSTRACT 


The rapid increase in the number of new instructional 
staff at post secondary institutions, who for the most part do 
not have certifiable pedagogical expertise, has led to the 
problem of providing in-service pedayogical programs. The 
essenial purpose of this study was to evaluate a system of 
evaluation for these in-service modular programs. This second 


order evaluation is termed meta-evaluation. 


TO carry out this study it was necessary to embark on 
five sequential phases of methodology: 1) develop a sample of 
modules of in-service curriculum, 2) prepare an operational 
evaluation model, 3) deliver the nodules of in-service 
instruction, 4) use the evaluation model to evaluate the 
performances of the in-service curricula, and 5) report on the 


meta-evaluation. 


TwO sample modules of curricula were developed. They 
were called the Adult Learning module and the Psychomctor 
Learning module. For the preparation of the operational 
evaluation model the Stake Model of Curriculum Evaluation was 
adopted. Many instruments had to be developed. A pilot study was 
conducted at Algonquin College in Ottawa to provide feedback for 
refinement of the modular content and the data collection 


instruments. 
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The two modules were each taught to two different 
groups of representative instructors from the Northern Alberta 
Institute of Technology (N.A.I.T.) and all pertinent data for the 
evaluation model was collected. This data waS Summarized and 
prepared for presentation to a “blue chip" group of judges fron 
N.A.I.T. This group of decision makers (five Department leads 
from N.A.1.T.) were instructed to process the data through the 
judgement matrix of the operational evaluation model; in essence, 
they made decisions with respect to the success of the two sample 
in-service modular programs. It was observed that in fact this 


judgement group did arrive at concensus decisions. 


The meta-evaluation portion of the study constituted 
the assessment of the success of the evaluation model employed. 
This assessment was done by the five decision makers with the aid 
of an instrument which asked for the rating of the operational 


model on eleven criteria. 


The results of the study showed that the evaluation 
model did function; that concensus and meaningful decisions could 
in fact be made by applying the model. The results of the 
assessment also showed various places where the sample could be 
improved. Results as to the main purpose of the study (meta- 
evaluation) showed that the model was rated high on ten of ‘the 


eleven criteria. 


There were many recommendations; however, the essence 


of all recommendations can be summarized by the following two: 1) 


ay) Senora sa eagle 13 
ince Wi Alain nots eae dean 
siqnae od @Ay aa aria aia 69 romans dni wen Qe eevee aale  PaE 
wins — diiansd tawleedal ane Gi leldbreesh sulaned bsieane a 5 9y 
evel tuk fi) died da. adit eh ek ——— . 


Neiudiseets (ours GAy 1H. Rots te Lad Lay >~ Aree eat: 6 24 


a iphor oh iieb less pn) At dae wontss eels “ba ace ah! ile 
ais wircudle weeded sie hy esd, WHE: ye heh, ae Jwawnap 908 ED 
ana 085 ald ciel) Geaee cei Jscayern ent * ae te 

vpeaed Lyte Geeete he (Rae 


a 


tanivateda sili 


‘oheoa tae Bhs avda, Heeiee EPyan Bas, om S55 es ei? * 


Kigos baweetiiek Ina puilp ® bayevensoRey te 42’ swodo ores vib io 


one We aoe tergg ORR . tah: ate vakecags yd obi 9 ot aaa 
af toves olammm 44s seal shrek eoultn? aed GE th vom 
widten) hese egd) Yo anh ia oti” aa he he ‘eatwnet os 
A al apie tasgteee Vebea loge Dats re aed 
; : iit 


» 


comelnn opt pap aeeniys htt shnenrae ies, sents 
Me i vy rae ai 


that this operational evaluation model based on Stake's Model be 
employed to evaluate modular in-service curriula, with the 
initial major emphasis on the refinement of instrumentation and 
the development of relevant data bases for further and wider 
application; and 2) that this evaluation model should be employed 
in adult learning contexts as a negotiation tool for the "on the 
spot" development of curriculum and subsequent evaluation of 


curriculum. 
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CHAPTER I 


THE PROBLEM 


Institutions of post secondary education have recently 
been increasing in number and size, The numbers of trade, 
technical and adult basic education proyrams offered by these 
institutions have shown phenomenal growth. Pre 1960 enrollments 
in post secondary programs were relatively low and characterized 
by steady rates of increase, With the inception of the Technical 
Vocational Training Assistance Act of 19490 enrollments in trade, 
technical and adult basic education programs have been increasing 
rapidly. Evidence “of this rapid rate of expansion can be easily 
seen when, for instance, we examire the figures for numbers of 
instructional staff at the Northern Alberta Institute of 
Technology (N.A.I.T.) for the past fourteen years. Table 1 shows 


these figures. 


Rapid expansion at post secondary institutions has resulted in 
the hiring of many new instructors who first have expertise in a 
trade or discipline, and secondly, who jiemonstrate an ability or 
a potential ability to teach. Certification of pedagogical 


competence has not been a requirement for employment, 
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Table 1 


Numbers of Instructional Staff at N.A.I.T. 


Year No. of Staff Year W@ig (Ope Greece 
1962 50 1969 398 
1963 144 1970 4O9 
1964 190 1971 Oy 
1965 238 1972 475 
1966 292 1973 494 
1967 B72 1974 538 
1968 389 1975 569 


Accompanying the fact that large numbers of new 
instructors are employed each year is the added phenomenon that 
in most trade and technology programs there has been demonstrated 
nee i for much curriculum development and re-development. Not only 
has rapid technological change placed a demand upon _ the 
curriculum developers to keep content valid; hut additional 
deminds have been made upon instructors to incorporate 
pedagogical changes, especially in the direction of providing for 
flexible and accelerated training programs. The offering of 
comvetency based programs has become the goal of moet 
inscitutions and adds yet another dimension to the "new" skills 
required for instructional staff, In summary, the restructuring 
of content and instructional processes has become a week to week 
responsiblity of virtually all instructors in the majority of 


technically oriented post secondary institutions, 
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Many post secondary institutions have recognized the 
need for instructional staff to improve their instructional and 
curriculum development skills. Sabbatical and other educational 
leaves attempt to fill this need but fall short of the mark. 
There are too few leaves available (2-4% of staff complement 
annually is average) and a considerable number of instructors at 
the technical institutions are unable to utilize these leaves for 
improving instructional expertise because they do not have the 
necessary "academic qualifications" to be permitted registration 
in faculties of education at universities, which is where these 
competencies are traditionally developed. Estimates of the number 
of instructors at N.A.I.T., for instance, who could not utilize 
leaves for development of pedagogical skills or certification of 
same, range petween thirty and forty percentof the total 
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In-service programs (operated in-house) are considered 
to be one answer to the problem. N.A.I.T. iS representative of an 
institution which is attempting to meet the challenge in this 
way. In addition to a program of pre-service orientation and a 
mandatory in-service program for first year employees, N.A.I-T. 
is planning a permanent in-service program designed for all 
instructors to participate on a volunteer basis. Incentive for 
volunteer participation 1s provided by advancement on the pay 


Manteiadxe 


Other post secondary institutions in Alberta and Canada 
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are at various stages of identifying their needs and/or 


attempting to meet the challenge presented by these needs. 


There will be a stage in the independant development of 
in-service programs at various institutions when the sharing of 
plans and programs will be beneficial, One way of maximizing the 
relevance of the in-service curricula, and also making 
implementation an eaSier task, 1S to involve in-house personnel 
in the planning and implementation activities. Portions of 
curricula developed at one institution would be adaptable and 
useful Tat, other Jinstitutions, but “orly if they “are made 
operational by in-house involvement at the borrowing institution 


with due concern for specific institutional inputs. 


The need for evaluation of these in-service programs is 
important on two accounts. First, formative evaluation must be 
carried out because of the uniqueness of programs at each 
institution; and second, if efficient utilization of new 
curricula and processes is to come about, both at the developing 
institution and at a borrowing institution, there must be the 
ability to measure the success at various stages of 
implementation, The most impelling reasons for the need me 
evaluate in-service programs come about trom the unigue nature of 
the programs which are required to meet extremely divergent needs 
of the clients of these programs. The clients of these programs 
are the individual members of the instructional staff of the 


institutions. This group of clients is characterized by extreme 
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divergence in expertise and interests which comes about from a 
large degree of variance in: amount and kind of formal education; 
years of work experience; age; area of content expertise (whether 
it be trade, technology or engineering occupations); and amount 


and kind of pedagogical experience, 


Individualizing the learning processes is an imperative 
long range goal of relevant in-service programs, and because of 
the large quantity of resources which need to be committed, the 
efficiency of the programs will in all 1likelihood be closely 


examined by authorities in control of operating budgets. 


Statement of the Problem 


The problem is that at the present time, with the rapid 
increase in the number of new instructional staff at post 
secondary technical institutions, there is a need to rapidly 
develop operational in-service programs directed at improving 
pedagogical skills, The problem is compounded by the following 
factors: 1) large numbers of new instructional staff are hired 
each year and many have no certifiable pedagogical skills, nor is 
much regard given to academic background when hiring, but rather 
the major emphasis 1S on technical competence; 2) these large 
numbers of new instructors have to assimilate into the programs 


and procedures of the various individual institutions and 
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departunents; 3) curricula are changing rapidly both in content 
and processes; and 4) no useable mode] for the development and 


monitoring of in-service programs is currently available. 


The essential purpose of the study was to develop a 
sample of in-service curriculum and an operational model to 
evaluate the performance of these in-service modules with 
instructional staff at post secondary institutions. This latter 
purpos? amounts to an evaluation of an evaluation process. In 
recent literature the term "meta evaluation" has evolved to 
descrive the processes of evaluating an evaluation activity. No 
operational model was found for this task, and this study was 


designed to meet this unique problem. 


Many factors were operative at the onset of this study, 
the most significant factor being that most institutions surveyed 
were at least at the preliminary planning stages in the 
development of a Wiable in-service program. N.A.L.T. ie 
identified as one institution significantly committed to the 
development of some form of continuing in-service program so as 
to he receptive to the purpose of this study. Algonquin College 
in Ottawa was also identified as receptive and subsequently was 


utilized in a pilot study, 
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Because of the formative stages of in-service programs 
at most institutions, the purpose of this study had to be 
specifically concerned with the following sequence of 


requirements: 
1) develop a sample of aoduiee of in-service curricula. 
2) prepare an operational evaluation msnodel. 
3) deliver modules of in-Service instruction. 


4) use the evaluation model to evaluate the performance 


of the in-service curricula. 


5) evaluate the evaluation by reporting on the results 
of the meta-evaluation (effectiveness of the operational 
evaluation model for evaluation of modules of in-service 


eurricula). 


Major delimitations are: 


1) only one major institution (N.A.I.T.) waS involved 


in the development of the operational model. 


2) only a sample of the in-service curriculum at 


N.A.I.T. was developed and evaluated. One intention of N.A.I.T. 


is to have the curriculum modularized to provide many points of 
entry and exit. This design would allow the development for 
complete curriculum for each module as a separate entity, and the 
design of this study was to develop a sample of two modules of 
content within the curriculum. The selection of which two modules 
to be developed within this study was based on results from a 
study previously conducted at N.A.I.T. The section of this study 
on methodology (Chapter III) describes the procedures and 
criteria utilized for this selection, and also makes direct 
reference to the pilot study conducted for this purpose. The two 
modules selected were "Psychomotor Learning” and “Adult 


Learning", 


3) time credit restrictions suggested as necessary by 
the personnel department of N.A.I.T. for the in-service program 
delimited the length of time devoted to instruction for each of 


the selected modules of curricula. 


The main purpose of this study was to develop an 
operational model to evaluate the performance of the sample in- 
service modules, and to be utilized by various post secondary 
institutions in the future to evaluate in-service curricula. The 


core of this operational model is based on the curriculum 
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evaluation model by R.E. Stake (1967). Stake's model is depicted 


in, Figure 1. 


INTENTS OBSERVATIONS STANDARDS JUDGMENTS 


RATIONALE No.7 


ANTECEDENTS 


TRANSACTIONS 
No. 


No. 4 9 


No.6 OUTCOMES wo 14 


DESCRIPTION MATRIX JUDGMENT MATRIX 


Figure 1. A Layout of Stake's Model 


The intent of this study was to use the classification 
of data depicted by Stake's model to guide the phases involved in 
the development of the “operational model", The additional parts, 
as it were, in the operational model will be those guidelines 
(ce: selection of appropriate committees, etc.) found to be 
necessary to guide the decisions in the specific tasks related to 
the development of the in-service program at any specific 
institution, with its specific intents, and suggested procedures 


which allow for the generalization to other institutions with 
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different intents. 


The selection of Stake's model is briefly rationalized 
at this time, and is dealt with in more detail in the review of 
literature (Chapter II). Stake's model is more applicable than 
others because of the developmental tasks involved in the study 
where many unique inputs are anticipated. Stake's model, an 
eclectic model, best ensures that the right questions and all the 
questions are asked. Mackay and Maguire (1971,p.16) aptly 
demonstrate this point. 

In summary, it is useful to highlight three 

kinds of models of evaluation. Each reflects 

the background and concerns of its authors. 

Neo-Tylerian models such as Walbesser's focus 

on the learning process and the sequences of 

objectives necessary for achievement, The 

role of evaluation is primarily formative. 

The eclectic models, like Stake's focus on 

the collection of data hoth to answer and to 

raise questions. Administrative models, like 

Stufflebeam's are closely tied to the 

collection of information for particular 

decisions. 
Stake (1967) stresses the importance of collecting data from a 
wide range of sources, He points out that data are divided into 
two dimensions: one dimension separates the data into 
descriptions and judgments; the other dimension classifies data 
into antecedent, tranaction and outcome, Determining the deqree 


of relationship and agreement among the various classes of data 


amount to the total evaluation necessary. 


In the review of literature (Chapter II) additional 


perspective into the concepts and procedures of Stake's model 
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will be presented by examining the data processing procedures for 
the "descriptive matrix" and the "judgment matrix", In addition 
Stake's Model is analyzed in detail in relationship to other 


evaluation models, 


Summary 


In this chapter the problem has been identified with 
emphasis on the need to develop an evaluation system for in- 
service pedagogical programs. The purpose of the study was 
outlined in terms of five major criteria required to confront the 
problem in its formative and unique context. In addition this 
chapter outlined the delimitations of the study, and presented a 
brief outline of the theoretical framework of the evaluation 


mod=1 to be employed, 
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CHAPTER II 


REVIEW OF THE LITERATURE 


This chapter reviews the literature relevant to: the 
definition of curriculum evaluation, curriculum evaluation 
theories, curriculum evaluation models, Stake's Model of 
curriculum evaluation, and meta-evaluation. Stake's Model, which 
forms the foundation for the operational model of this study, 1s 
described in detail and criticized in comparison with other 
models, The relatively new concept known as meta-evaluation is 
discussed with a view to identifying procedures to be employed in 
this study for the purpose of conducting a meta-evaluation with 


the operational model, 


Many educational writers would approach the problem of defining 
"curriculum evaluation" by concentrating firstly “on the 
definition of curriculum. Obviously, this would reveal a wide 
Canging discussion as to the extent of the required detail, 
ranging from a broad set of definitions as representative of Taba 


(1962) to a rather specific definition of curriculua 
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representative of Gagne's (1965) thinking. Rather, it makes for 
better clarity in the end to define “curriculum evaluation" as a 


whole with the emphasis on the term evaluation. 


According to Guba and Stufflebeam (1979) a definition 
for evaluation must be based on a set of premises, and they 
identify five premises. These are: 1) to evaluate it is necessary 
to know what decisions are to be served, 2) different strategies 
are required for different settings, 3) different types of 
decisions require different types of evaluation designs, 4) a 
single set of generalizable steps can be followed in the design 
of any specific sound evaluation, and 5) evaluation criteria must 
satisfy both scientific adequacy and practical utility. They go 
on to state specifically that "Evaluation is the process of 
obtaining and providing useful information for making educational 
decisions" (p.15). Six key terms are identified by Guba and 
Stufflebeam (1970) and the importance of these terms to the 
definition is stressed. These terms are: "process" (defined as a 
particular activity involving a number of steps or operations), 
"obtaining" (defined as making available through such processes 
as collecting or reporting), "providing" (defined as fitting 
together in systems), "useful" (defined as appropriate to agreed 
upon criteria), "information" (defined as descriptive or 
interpretive data about entities), “education decisions" (defined 
as choices among alternatives), with "decision" being the key 


term in the entire definition of evaluation. 
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The stress on the word “decision” when defining 
curriculum evaluation is also supported by Cronbach (1972). He 
has identified three useful functions that evaluation performs, 
each relating to the importance of decisions. They are: 1) 
decisions for course improvement, 2) decisions about individuals 
to better identify the needs of learners, and 3) decisions about 
the worth of an educational system and of its instructional 


Stati 


Along a Similar vein Taylor and Maguire (1972, p.89) 
identify the importance and emphasis on decisions in curriculum 


evaluetion when they state: 


Curriculum evaluation can be viewed asa 
process of collecting and processing data 
pertaining to an educational program, on the 
basis of which decisions can be made about 
that program, The data are of two kinds: (1) 
objective descriptions of goals, 
environments, personnel, methods and content 
and immediate and long range outcomes; and 
(2) recorded personal judgments of the 
quality and appropriateness of goals, inputs 
and? <outcones,. The data —- “an both raw and 
analyzed form - can be used either to 
delineate and resolve problems in educational 
programs being developed or to answer 
absolute and comparative questions about 
established programs, 


To turn attention away from the mere definition of 
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curriculum evaluation towards the processes of curriculum 
evaluation, we examine some of the thoughts of Taylor and Cowley 
(1972). They state the history of curriculum evaluation is easily 
subdivided into three eras: pre 1930's, the Ralph Tyler era, and 
the present era. Each of these era's display their own character. 
Characterizing the first era ‘evaluation waS equated almost 
exclusively with the administration of standardized tests. 
Comparisons, when these were appropriate, were made between two 
groups or between a target group and a set of norms" (ps ja. The 
second era was dominated by a model eStablished by Ralph Tyler 
and his associates, and was characterized "hy its stress on 
stating objectives behaviorally and a lack of stress on valuing 
the objectives themselves" (p.4). The characterization of "the 
present era of evaluation has been the attempt by several writers 
to formulate a conceptual framework for curriculum evaluation" 
(p.4). It iS within this present era of curriculum evaluation 
that the various current models of evaluation are unfolding. They 
are any > and each has its own uniqueness, but they all concern 
themselves with something more than "testing", and they all 


recognize the role of judgmental functions. 


To set the stage for the full understanding of the 
range and kinds of evaluation models that were reviewed it is 
important to examine the contribution of Scriven (1967) in 
establishing order in the terminology and definition of 
curriculum evaluation. His contribution is greatest in the theory 


of evaluation while leaving it to others to develop the practical 
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framework (models) to put this evaluation theory into practice. 


Scriven states that particular attention must be paid 
to the distinction between goals of education and the role of 
education, The goals are relatively easy to identify and "this 
activity consists Simply in the gathering and combining of 
performance data with a weighted set of goal scales to yield 
either comparative or numerical ratings" (Scriven, 1972). He goes 
on to point out that the role to which evaluation is directed is 
enormously varied and constitutes the major concern when 


designing an evaluation activity. 


Scriven also deals directly with the @istinction 
between formative and summative evaluation: formative evaluation 
refers to the evaluation of programs while they are being 
developed, while summative evaluation refers to the evaluation of 
programs that are already in use, The major implication of the 
distinction between these two forms of evaluation relates to the 
roles of the evaluation personnel. For formative evaluation the 
evaluator must work closely with the curriculum builder 
(sometimes these two functions are carried out by the Same 
personnel), while for summative evaluation the evaluator must be 
independent and free of any potential stigma or conflict of 


interest. 


Like Cronbach, Scriven prefers non-comparative 
evaluation better to assess the merit of an entire program. He 


suggests that there are two differing approaches to evaluation. 
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One is "instructional" and the other is "consequential", The 
first concentrates on the content, goals and processes; while the 
second approach examines the effect that the program has on the 
learner, He recommends that the evaluation be planned to take 


advantage of both of these two approaches, 


In his criticism of B.S.Bloom and others, Scriven 
(1967) insists that the evaluator not only apply specific 
scientific criteria and methods for evaluation but also exercise 
value judgments and determine their appropriateness to the 
specific tasks at hand, In reference to evaluation of higher 
education, Scriven (A973) Supports earlier statements by 
identifying some of the major benefits that can accrue from 
interaction between the evaluation system and the system being 
evaluated. This is in full support of that kind of evaluation 


Classified as formative evaluation, 


Recent work by Scriven (1974) ain relationship to 
evaluation of competency based education attacks the problem of 
the worth of considerable effort involved in competency based 
education aS compared with traditional approaches. His main 
concern centers around the need to examine all the new and unique 
aspects of competency based education; and at the same time, 
not lose sight of the program as a whole, The evaluation of the 
‘whole’ would necessarily require the examination of cost 


effectiveness. 


In conclusion of Scriven's major contributions to 
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curriculum development his influence on "“Goal-Mediated® 
evaluation must be discussed, Paramount to this question is the 
necessity to distinguish and encourage three types of activities 
centering around the formulation of goals. Accordingly, it is 
essential’ that: “in the first-place the goals as so far 
formulated should be regularly re-examined and modified in the 
light of changes in the actual activities,... Secondly, work 
should be begun on the construction of a test-question pool.... 
The third activity that should commence at some intermediate 
stage is that of getting some external judgment as to the 
cohesiveness of the alleged goals, the actual content, and the 


test question pool" (Scriven, 1972, p.36). 


Post 19690 theorists generally emphasize the need to 
look beyond the evaluation of end products into examining the 
processes and strategies of complex goals. Meese (1971) points 
out that several instruments have emerged more recently from 
curriculum projects which focus on process goals. One typical 
example of a curriculum project which focuses on process goals is 
Science - A Process Approach , designed by the American 
Association for the Advancement of Science Commission on Science 
Education (1969). This study is mentioned to demonstrate the 
point that instrumentation for process evaluation is being 


developed and utilzed. 


Generally, the emerging trend relative to refined 


thought on curriculum evaluation is representative of statements 
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made by Tuckman (1967) which emphasize four problems to "built 
in" evaluation. These include: 1) the problem of too tightly 
defined behavioral objectives which narrow the scope of data 
collected, 2) a concern for the lack of significant emphasis 
being placed on aAdentifying the purpose for evaluation, 3) an 
overSight of the problem related to the dynamics of an ongoing 
learning activity, and 4) lack of expertise in collecting data 


which is simple and reliable and is at the same time general. 


To sum up this section on curriculum evaluation 
theories the following guote from Atkin (1972, p.22) is presented 
as representative of the thinking of curriculum model builders of 
recent times, 


It iS universally accepted that 
evaluation should be central to course 
improvement, But only when evaluation is seen 
as facilitating rather than limiting function 
will ait be utilized more effectively by 
curriculum developers. To achieve this end, a 
flexible approach to the role of evaluation 
must be fostered by evaluation specialists 
themselves; there must be willingness to 
question some of the conventional wisdom that 
has been accepted for decades, possibly with 
little analysis of the appropriateness today 
of the basic assumptions. 


Curriculum Evaluation Models 


a ee a ae a a ee 


Before launching into a description of current evaluation models 


it is interesting to note the solution to the problem of 
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selecting evaluation models for a major curriculum development 
and evaluation project (Borgen & Davis, 1970). It is interesting 
because they very quickly reject the earlier models. 
"Consultants, Sjogren and others, pointed out that the 
accreditation and Tylerian models have been applied most often in 
the past, but the appropriateness of these models for 
developmental efforts is limited," (p.37). Their main concern is 
Simply that "the accreditation model applies arbitrarily arriyed- 
at standards for judging a program and the Tylerian model focuses 
mainly on measuring the attainment of objectives, tending to 
ignore inputs and processes {(p.37). The consultants to this 
project felt that "either a management-systems Or a summative- 
composite model would be most appropriate for this developmental 
project," (p.37), and they go on to select the Stufflebeam (1968) 
model as the best management systems model; and the Stake (1967) 


model as th2 best summative-composite model. 


This -section will present and discuss several 
curriculum evaluation models, and then return to a detailed 
discussion of the stufflebeam model (CIPP model) and the Stake 
model. The Stake model will also be examined for operational 
processes, as it forms the foundation of the operational model 


employed in this study. 


Perhaps one of the first models to be formulated in the 
"new era of curriculum evaluation" is the model proposed by Taba 


and Sawin (1962). This model demonstrates an intentional switch 
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in the focus of evaluation from the outcomes of learning to the 


process of learning. 


A model which emphasizes the importance of stating 
objectives in identifiable behavioral responses by Tuckman (1967) 
is called "Curriculua Renna: for the Fvaluation of Course 
Knowledge" (CHECK). The CHECK model dwells on the process of task 
analysis for the purpose of identifying hierarchial sets of 
objects, which in turn can be measured and the results compared 
to a control program. This model exhibits the narrowness of 
approach so strongly criticized by many of the authors of 


curriculum evaluation theory. 


The Expected Opportunity Loss (F.0.L.) model described 
by Tanner (1970) concentrates on a complex set of procedures to 
determine program utilty, program costs, and program selling 
price. sit rates: these factors .on the basas of their expected 
contributions to the primary objective of the total program. It 
is not a traditional cost-effectiveness model, however, in that 


it places less emphasis on the cost Components. 


Parsons and Tenenberg (1970) examined the common 
"means-end" model of curriculum evaluation and reject it on the 
grounds that "the means-ends framework , in which the curriculum 
elements are means and changes in the pupils the ends, offers 
little assistance in formulating effective steps in introducing 
new curricula into ongoing school situations and insuring that 


appropriate curriculum elements are in fact instituted," (p.5). 
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They recommend a transactional model which is_ graphically 


displayed in Figure 2. 
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Figure 2, A Transactional Model of Curriculum Evaluation 


It can be seen that the Parson and Tenenberg transactional model 
would be particularly useful for certain kinds of curriculum 
evaluation such as the one they studied ("patterns in Human 
History"), The usefulness of this model in less human interaction 


content curriculum is questionable. 


Another proponent of a curriculum evaluation model 
Which concentrates on identifying the domain and level of 


diffiulty for instructional objectives is Robert L. Uffelman. A 
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description of the model proposed by Uffelman (1970) is 


AnFigqgure 3. 
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Uffelman's Model for Analyzing and Comparing 


Instructional Strategies and Programs 


This model permits the instructor to identify which psychological 


theory is acceptable to 


nature of the instructional data. 


model is that it 
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An interesting approach to the _ probler of data 
collection of processes activities in programs is recommended by 
Pahland (1970). He recommends the use of "enthography", the task 
of recording story-book-like accounts of hourly, daily or weekly 
activities of all participants in a program. He applied the 
skills of the enthographer in a conceptual model developed at the 
Central Midwestern Educational Laboratory (CEMREL Model). Fiygure 


4 depicts the CEMREL evaluation model. 
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Figure 4. The CEMREL Evaluation Model 
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Summative evaluation (the role); determines who the information 
is for (the focus); and identifies the kinds of data that should 
be collected (the data). Once the selection of a cell or cells 
has been achieved, then various data collection technigues are 
employed, including the process of enthography, In this latter 
respect the CEMREL evaluation model is similar to the model 
proposed by R.E. Stake, Pahland stresses the unigue importance of 
both hard data (collected with traditional tools) and soft data 
{collected by orthographical technigues). It must be kept in mind 
that orthographical data can only be analyzed with respect to the 
"whole" story, and as such tends to favour the summative 


evaluation role, 


One of the more comprehensive models for curriculum 
development has been utilized by Daniel L. Stufflebeam. fhis 
model's main characteristic is that it is an administrative model 
in that it defines evaluation as the process of acquiring and 
using information for making decisions with respect to planning, 
programing, implementing and recycling program activities. 
Stufflebeam (1971,a) has labelled this model the CIPP Model after 
the four stages of evaluation. Figure 5 describes these four 
stages (Context, Input, Process and Product) in relationship to 
th: "operations" that need to be carried out to utilze this model 


for either proactive or retroactive purposes. 
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PRODUCT 
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Four Phases of the CIPP Model 


Stufflebeam explains the purposes of the four types of 
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(of information to decision makers). The purpose of context 
evaluation "is to systematically provide information that can be 
used by decision makers to make plannirg decisions regarding the 
establishment of new objectives, modifications of existing 
objectives, or confirmation of ‘present objectives," (p.5). He 
goes on to state that the purpoSe of input evaluation is "to 
identify and assess alternative program strategies for achieving 
given objectives and to provide intormaticn to assist in 
detailing particular strategies," (p.8). "Process evaluation is 
designed to provide information during the implementation stages 
of a project or program" (p.9), and ass secondary purpose, 
according to Stufflebeam, is to "provide a complete description 
of the actual program activities" (p.10). A final statement by 
Stufflebeam, with respect to purposes of evaluation stresses that 
Simply stated "the purposes of product evaluation are to relate 
outcones tO objectives and to assess the overall of a procedure 
an teres of its effects™ (ps1). To more fully understand ths 
relationship of evaluation to decison making, an essential 
feature of an administrative evaluation model, Figure 6 should he 


examined. 


The CIPP Model offers great promise of providing both 
external and internal validity to the evaluation process, 
Stufflebean (1971,b) having great hope for this model, is 
confident that it is the best model available for evaluation of 
large scals projects when he states, “irrespective of the size of 


the evaluaion effort or the magnitude of the decision making 
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processes involved, the CIPP model probably affords the most 
comprehensive conceptualzation of education currently available" 
(p.28). However, he admits that the effort involved in using the 
model may only be worthwile (have an effective pay off ratio) if 
in fact the evaluation task 1S great; this he concludes because 
of the need to adopt existing methodologic and/or develop new 


methods leaving a great deal of effort yet to be accomplished. 
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Figure 6. The Relationship of Evaluation to Decision Making 


Additional concern regarding the feasibilty of the CIPP 
Model, given current methodology, has been expressed in the 
Report of the Phi Delta Kappa Study Committee on E&valuation by 
Michael (1971). He identifies the feasibility problem as one of 


having to develop new methodology “especially in reference to the 
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context, input, and process components that tend to be somewhat 
more closely associated with formative evaluation than with 
product evaluation" (p.20). He is optimistic that these new 
methodologies will be developed, but notes that to a large extent 
they do not exist at this time (note: this conclusion was drawn 


in February, 1971). 


The theoretical model proposed by ‘Taylor and Maguire 
(1972) shown in Figure 7 1s one of the first signs of real 
concern towards the problem of human judgments. The first 
publication of this article being in 1966, one year before Stake 
first outlined his model, and the manner with which judgments are 


treated suggest that it was a forerunner to Stake's Model, and 
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Figure 7. A Theoretical Evaluation Model 
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undoubtedly influenced its development. It, like Stake's Model, 
provides help to the curriculum developer to decide which are, 


for his purposes, the most pertinent questions to ask. 


The application of the systems approach to evaluation 
is probably best represented by the Discrepancy Model of 
evaluation perfected by Provus (1972). In Figure 8 we can see the 
outline for the five stages of evaluation with an emphasis being 


placed upon standards. 
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Figure 8. Evaluation Stages 
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In true application of the systems approach standards 
are not permanently established, but may fe modified when 
feedback is received from the system in operation. Discrepancies 
are identified by locating differences between an established 
standard (at one particular time in the process) and actual 
aciievement. ProvuS goes on to state that when significant 
discrepancy data are identified, four decisions are possible: a) 
continue to the next stage, b) redefine the program standards or 
processes and recycic, <<) recycle’ £6) the first (stage, or a) 


terminate the program, 


The similarity between the Provus Model and Stake's 
Model is seen most vividly at Stage I (the design stage). Figure 


9 displays the dimensions of the design criteria, 


The Similarity is demonstrated by the obvious) likeness 
between the terms and their meanings for the following sequence 


in Provus's Model: inputs, process, and outp 


Ie 


ts; and the sequence 


in Stake's Model: antecedents, 
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The most apparent utilitarian weakness to the Provus 
model for purposes of this study is the fact that many inter- 
stage relationships exist that are difficult to sort out and/or 
predict unless the model 1s appled over many instances (aoe: 
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utilizing the feedback to modify standards and processes many 


times). 


INPUTS PROCESS OUTPUTS 


Variables-the things the program is Variables-those activities which Variables-the changes that have 
attemting to change change inputs into come about 
desired outputs 


A. Student Variables A. Student Activities A. Student Variables 
B. Staff Variables B. Staff Activities B. Staff Variables 
C. Other Variables C. Other Variables 


1. Functions and duties 
2. Communication 


a. Inter-staff 
b. With Others 
. Preconditions-the things that are Preconditions-same throughout the 


pre-requisite to program 
program operation 
yet remain constant 
throughout the 
program 

Student Conditions 

Staff Qualifications 

Administrative Support 

Media 

Facilities 

Time 


. Criteria must be specified for each Crireria must be specified for each Criteria are specified on the variableg 
input variable and precondition of the process variables to define the goals of the program. 
above, The criteria specified for The participant is released from the 
student variables and preconditions program if he achieves the goal of 
constitute the selection criteria of the program or if he violates a 
the program. precondition. 


Figure 9. Design Criteria 


Up to this point this review of literature has 
described and criticized several curriculum evaluation models. 


None of these models was selected to provide the foundation for 
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thi operational model of this study because of these noted 
criticisms. However, Stake's Model was selected to form this 
foundation, “Lor, in the opinion of the Tesearcher, At “is best 
suited to providing a comprehensive framework, while at the same 
tine being suited to the "low cost™® (i.e. evaluation of indiviual 
modules of curriulum) application identified in this study. 
Following is a detailed set of descriptions and critiques of 


Stike's Model. 


in, Chapter 1 -of taiS “study under the topic of “Theoretical 
Framework of the Model", Stake's Model was introduced. Figure 1 
(Chapter I) provides the layout of Stake's Model, while mention 
was made of the separate importance of the "cGescriptive matrix" 
and the "Judgment matrix", It would be aelpful for clarification 
of the model to distinguish between antecedent, tranSaction, and 


outcome data. An antecedent, according to Stake (1966) is any 
condition existing prior to teaching and learning. Transactions 
are the countless encounters between teachers and students, 
students and students, students and other personnel and other 
sources of knowledge or other interfaces with an opportunity to 
react. The boundaries between what is artecedent data, and what 


is transaction data are not always totally clear. Outcomes are 


the data synonymous with achieved abilities, attitudes, 
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knowledges, skills and the like of students resulting from the 
educational experience, At the planning stage of an educational 
program (INTENTS) the boundaries and relationships between 


antecedents, transactions and outcomes must be Specified. 


Ideally there is a logical contingency between the 
three kinds of data. The specification of the intents for the 
three kinds of data would follow a pattern similar to: 1) 
exjecting these antecedents, 2) and expecting these kinds of 
transactions, 3) these outcomes should be attained. However, they 


are not necessarily specified in the timeline sequence suggested 


by this description. 


Examination within the descriptive matrix of Stake's 
Model helps clarify this relationship. This clarification Can 
come about only by examining the processing activities that are 
played out in the descriptive matrix, which is represented in 


Figure 10. 


Stake points out that there are two principal ways of 
processing descriptive data. These are oO determine the 
contingencies among the antecedents, transactions and outcomes; 
ani to find the congruence between intents and observations. 
Contingencies are of two types, logical and empirical; the first 
tyoe referring to the relationships that should exist, and _ the 
latter type referring to the relationships that are observed to 
exist, The establishment of logical contingencies is a question 


of expert judgment and is ideally determined at the planning 
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phase of all educational programs. Empirical contingencies are 
based on observations and are usually statistical problems of 


estimating the relationships among variables. 


Descriptive Data 


Intended Observed 
Antecedents 

CONGRUENCE eniscedene 
LOGICAL EMPIRICAL 
CONTINGENCY CONTINGENCY 


Intended 


Observed 
Trandeaione CONGRUENCE one 


’ Transactions 


LOGICAL EMPIRICAL 
CONTINGENC Y CONTINGENCY 


l 


Intended 
Outcomes —— CONGRUENCE 


Observed 
Outcomes 


Figure 10. A Representation of the Processing of Descriptive Data 
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To have a high measure of congruence between the cells 
of the intended columns and the cells of the observed columns, 
the intended antecedents, transactions and outcomes would have to 
come to pass, Mackay and Maguire (1971) make Significant 
statements in relationship to congruency by stressing two major 
points. “Firstly, it may be that incongruence is desirable in the 
long run, especially, if the intents can be shown to be invalid 
for some reason, Secondly, congruence does not assure validity, 


only fidelity™ (p.31). 


In describing the function of the judgment matrix, 
Stake (1967) states that there are two bases for judging the 
characteristics of a program, "1) with respect to absolute 
standards as reflected by personal judgments and 2) with respect 
to relative standards as reflected by characteristics of 
alternate programs" (p.532). Standards upon which to base the 
judgments will likewise have to come from either absolute sources 
(expert selection) or relative sources (other programs or norms). 
In the same article (1967, p.533) Stake elaborates on the 


processes of making judgments, 


Before making a judgment the evaluator 
determines whether or not each standard is 
met. Unavailable standards must be estimated. 
The judging act itself is deciding which set 
of standards to heed, More precisely, judging 
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1S assigning a weight, an importance, to each 
set of standards. Rational judgment in 
educational evaluation is a decision as to 
how much to pay attention to the standards of 
each reference group (point of view) in 
deciding whether Or not to take some 
administrative action. 


Relative comparison is accomplished 
in similar fashion except that the standards 
are taken from descriptions of other 
programs. It is hardly a judgmental matter to 
determine whether one program betters another 
with regard to a single characterisic, but 
there are Many characteristics and the 
characteristics are not equally important. 
The evaluator selects which characteristics 
to attend to and which reference programs to 
compare to. 


From relative judgment of a 
program, as well as from absolute judgment we 
can obtain an overall or composite rating of 
merit (perhaps With certain qualifying 
statements), a rating to be used in making an 
educational decision. From this final act of 
judgment a recommendation can be composed. 
Figure 11 represents the processes ot judging the merit of an 
educational program, and it can ke readily seen that data from 
all six cells of the descriptive matrix must come into play in 


the decision making. 


Stake's Model has been described and analyzed. An 
examination into the applications of the model will allow for 
further insight into the operational feasibility of the model. 
Stake (1971, p.43) points out one of the major needs of 
educational evaluation that is pinpointe’ with the use of his 
model, but nevertheless it is very difficult to collect valid 
data for descriptive purposes. He makes this point by stating 


that "there is need for ways of expressing what people want 
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schools to be doing," and in relationship to the intents of a 
programa, "we do have priorities (but) what we fail to have are 


ways of representing them." 


ABSOLUTE 
COMPARISON 


DESCRIPTIVE DATA 
from 
ANOTHER PROGRAM 


RELATIVE 
COMPARISON 


DESCRIPTIVE DATA 
from 
ONE ea 


JUDGMENTS 


Figure 11. A Representation of Process of Judging the Merit of an 


Fducational Program 
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Doris Chertow (1970), in what she called A Practical 
and Feasible Adult Education Improvement Method, points out that 
the most successful data-collecting instrument she used in 
conjunction with Stake's Model was daily student recorder notes. 
The next most important instrument was the instructor's summative 
questionnaire mailed to students. Although she reports that this 
exercise illustrates how the Stake Countenance Model can be 
operationalized in a course for adults, she only reports 
activities relative to the descriptive matrix. Apparently the 


activities of the judgment matrix were ignored, 


Cox (1971) reports the use of the Stake Model in a 
"case example" format. He too has ignored the use of the judgment 
matrix. However, he does provide a good sampling of activities 
and procedures related to the descriptive matrix; both for data 
collection and data analysis. A major distinction made by cox is 
that there is inherently in any evaluation tasks that which he 
Calis) hard=count “data, ald Sort data” {perceptual  datajy. He 
outlines similar steps to handle both kinds of data. These steps 
include: 1) interviews with curriculum planners (teachers 1n his 
case) to determine the general goals of the program, 
2) summarization of all goals to Come up with a dist of 
"preferred" objectives, 3) observe and audio-tape-record class 


sessions, and 4) record results for both soft data and hard-count 
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data. The objectives described in the intended outcomes were 
Process objectives including interaction, cognition, subject 
matter, affective, and task; and, product objectives including 
character, cognitive, and affective domains. Cox compared, by 
percentage, the intentions versus the observations to get a 
measure of dissonance (amount of in-congruence). This comparative 


profile of intentions and observations is reported in Figure 12. 


Intentions 


Observations 


Process Product 


Figure 12. Comparative Profile Showing Dissonance 


Cox concludes that the production and comparison of such data are 
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the bare starting points of an evaluation process; and that 
judgments must now be made. He does not, however, in this study, 


go on to Carry out the processes of making judgments. 


Stake's Model has been reviewed and analyzed. It has 
become apparent that the model holds great potential £or 
evaluating in-service modular curriculum for teachers of adults. 
The problem, however, is to determine if operationally the model 
will suffice. The literature reviewed has not answered the 
question for, without exception, no explicit activity has been 
documented which utilizes Stake's Model to fruition; all authors 


have shied away from the processing of the judgment matrix. 


The following section on "meta-evaluation" will review 
the state of research models in doing these tasks. A strategy for 
conducting meta-evaluation will be discussed with the intent of 


applying it to the meta-evaluation of Stake's Model. 


Meta-Evaluation 


Conceptualzation of the process of meta-evaluation must 
be dealt with when attempting to define meta-evaluation, 
Stufflebeam (1974, p.68) discusses this definition in some 
detail. 

More specifically (meta-evaluation) 

is defined in this paper aS a procedure for 

describing an evaluation activity and judging 


it against a set of ideas concerning what 
constitutes good evaluation. 
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This, of course, means that meta- 
evaluation is higher-order evaluation, and 
that it includes evaluations that are 
secondary, tertiary, etc. This presents a 
practical dilemma, since meta-evaluation 
involves infinite regression, and since it is 
not practical to act on the infinite 
possibilities of evaluating evaluations of 
evaluations of evaluations.... it is 
emphasized that infinite regression is a 
fundamental part of the conceptualization of 
meta-evaluation. 
For this study meta-evaluation will be concerned with 
only second-order evaluations or, in other words, evaluation that 


is once removed from the primary evaluation. 


Stufflebeam goes on to outline five possible designs 
for meta-evaluation., These five designs are presented in Figure 


135 


Scriven (1972) considers the important aspect of meta- 
evaluation to be that it should ask, "What does the consumer most 
want to know?" (p,85). He also points out that the simplest 


taxonomies or the like be employed if possible. 


Wentling and Klit (1973), when applying meta-evaluation 
processes to a large scale evaluation system, concluded that the 
most important outcome (pay-off) of a meta-evaluation activity is 
the involvement of people (educators, researchers, learners, 
community figures, etc.) which resulted in a great increase in 


concern, understanding, and involvement. 
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Purposes of the 
Meta - Evaluation 


Pro-active 

Meta - Evaluation 
to serve 

Deeiston Making 
in evaluation 
work 


Retroactive 

Meta - Evaluation 
to serve 
Accountability 
in evaluation 
work 


Figure 13, 
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evaluation). 


They discuss each of these six problems and present 
some form of solution to most. In general terms this review 
literature (Chapter II) has dealt with all the problems with the 
exception of problem six, selection of appropriate criteria for 


meta-evaluation. 


Guba and Stufflebeam present an excellent list of 
criteria for meta-evaluation, These criteria are brought about 
from examining the information which the evaluation produces, and 
are classfied under two main kinds: 1) scientific criteria and 2) 
special criteria. A list of these criteria with definitions for 
each is reported in their study (pp.33-34), and is presented in 
total because of the importance of these criteria to this study. 


The scientific criteria are these: 
Internal validity The information provided by 
the evaluation must display a reasonable 
correspondence to the phenomena which it 
purports to describe or interpret, It must 
have fidelity, or, in the layman's sense, it 
must be true. External validity The 
information must be generalizable to similar 
Situations beyond the one in which it was 
collected, Particularistic data have little 
utility. If, for example, data relating to 
the effectiveness of an innovation could not 
be interpreted as also being valid in 
classrooms other than the ones in which they 
were collected, little would be gained in 
deciding whether to adopt or not. Reliabilty 
Here the concern iS with the replicability of 
the data. If a repetition of the evaluation 
did not produce essentially similar findings, 
we should be concerned that the findings were 
Simply random and therefore meaningless. 
Objectivity Here concern is with the 
publicness of the data. If data are private 
in the sense that only particular persons 


vos. siorrnce, eo ucakvarte 22 (M0 | 


: é m™ <4: 
; t= ; ian? pets ahh ne > ae 
> : 2 U 


» 17 4 
sid Save | Sicarteh betas Joo. we O48 20) 


a 


6 
7 “0°? .o ©'.o? 
9 KK 4 ag 2k 
< y ee eleee a tone | earn (a'S 9 
- ‘ 4-ry i? «@ 
} A i] =} 7 i y a) 
Fi ; at? rae | q 


; ‘ i Jip it Sue 
3 f mal au 
43 
72> 4 =) < i 4 

° o L pas 73 
© Sil > =e 
é Ag 

At, 4 » 

ale 2eo A? &: $b, . ase =< i 
a9 Ts pies | 623 DD ‘AGG SRe une 4 Suv OAT so 
fha .ft “7 retornas ite ae ~ aor 
eo 4 a = . in ani Fe 
ad ; SJa¢w oe: 
wel etatéel  .) cd odin ed ss ae 
coy c/as is Par) raf 4) A - ten re 


oz ve Cecsons ae Suds 


ball Pasi s ners eae 7 ae: al 
4a i?) r- C1 Ib ys = 


Fee 28 i oan ring gil? - is 
apdsaes snioa sabe oe . i BAY 
, 


would so interpret them, i.e., that not all 
competent judges would agree on them, their 
true meaning is subject to question. 


In addition to these four general 
criteria that could be invoked in relation to 
any information, certain special criteria of 
practical utility must be met by evaluative 
information. These are: Relevance The 
information must relate to the decisions to 
be made. Significance The information must be 
weighted for its meaning in relation to the 
decision. Not all relevant information is 
equally weighty. The culling and highlighting 
required is a professional task that 
justifies the inclusion of a  reportorial 
expert on the evaluation team. Scope The 
information must relate to all aspects 
involved in the decision, If there are six 
alternatives to be considered, informtion 
that applies to only four lacks scope. 
the decision-maker. Timeliness The informtion 
must come in time to be useful to the 
decision-maker. The evaluator must guard 
against the scientific value that argues 
against publishing findings until every last 
element 1s in. Late information is worthless 
information. It is better in the evaluative 
Situation to have reasonably good information 
on time than perfect information too late. 
Of Sihem cangvences” (i.6¢.,,):0" al Jot the 
decision-makers) who need it. Efficiency It 
is possible for an evaluation to mushroom out 
of all proportions to its value, The 
imprudent evaluator may produce a mountain of 
information whose collection imposes an 
intolerable financial drain. Proper 
application of the criteria of relevance, 
Significance, and scope should remedy the 
grossest inefficiencies. But even when the 
information proposed to be collected meets 
all of these criteria, there are probably 
still alternative ways for collecting it that 


differ in terms of the time, costs, 
personnel, etc., that are reguired. The 
criterion of efficiency will guide the 


evaluator to the appropriate alternative. 


An evaluator who can _ say, after 
careful examination, that his evaluation 
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design will produce information that conforms 

to all of these criteria can be assured that 

he is doing his job well. 

The literature relative to meta-evaluation was found to 
be very limited. However, that which was reviewed has yielded 
good guidelines as to the task and procedures of this emerging 
science. The only reported criteria were considered to be useful 


and will influence the methodology of this study. 


This chapter has reviewed the literature relevant to: 
defining curriculum evaluation, presenting and discussing 
evaluation theories, presenting and discussing evaluation models 
with an emphasis being placed on the model proposed by Stake, and 
discussing the processes and criteria of meta-evaluation. This 
review has presented relevant information for all of these topics 


and forms the foundation for the methodology of this study. 
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CHAPTER III 


METHODOLOGY 


This chapter describes the methodolgy of the study. The 
essential procedures utilized in the methodolgy provide the 
skeleton upon which this chapter is developed. This skeleton is 
derived from the sequence of requirements outlined in the purpose 


of the Study. This Sequence is to; 
1) develop a sample of modules of in-service curricula, 
2) prepare an Operational evaluation model, 
3) deliver modules of in-service instruction, 


4) use the evaluation model to evaluate the performance 


of the in-service curricula, and 


5) report on the results of the meta-evaluation 
(effectiveness of the operational evaluation model for evaluation 


of modules of in-service curricula). 


The above sequence of requirements then will constitute 
the major headings of Chapter III. Detailed procedures for each 


requirement are generally presented in a chronological order. 


The procedures and techniques reported here were tested 


in a pilot study conducted at Algonquin College in Ottawa during 
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May 1974, Results from this pilot study were utilized to help 
perfect the methodologies of this study, with the emphasis being 
On the assistance in the tasks of: preparation of the evaluation 
model, delivering the modules of in-service instruction, and 
using the evaluation model to evaluate the performance of the in- 


service curricula. The pilot study is reported in Chapter IV. 


The development of modules of in-service curriculum for this 
study involved two major tasks. Task number one was to select the 
appropriate modules from the total curriculum which would 
constitute the sample; and task number two was to prepare the 
content, identify the methodology, and prepare the instructional 


material for these sample modules. 


of Modules for the Sample was based upon 
a study by Manuel (1973) conducted at N.A.I.T. and the University 
of Alberta. All instructional divisions at Noihtebiative were 
represented by a sample of forty instructors. Twenty-eight 


potential instructors who were enrolled at the University of 
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Alberta also participated in the study. They had been given 
instruction dealing with several curriculum areas and ten of 


these areas were common to both groups. 


These ten content areas were structured to forma 
scaling instrument using Thurston's Matched Pairs (Torgerson 
LID ois The instrument was administered to the sample of 
instructors and potential instructors, requesting them to 
indicate the "most relevant" module for their teaching". Scale 
values resulting from this study indicated the relative perceived 
importance of the ten modules. The results of this scaling study 


are presented in Table 2 and Table 3. 


The scale values derived from the data are represented 
on an interval scale with a mean of zero and a standard deviation 
of one, No attempt was made to "fix" the scale and represent the 
values on a ratio scale. The values can be compared relative with 
each other, but not to an absolute criterion; that is to say that 
even though, for instance, number 9 (Psychomotor Learning) was 
"most negative for the total group, it cannot be interpreted that 
is was considered irrelevant but only that it was considered less 


relevant than others to which it was compared. 


The resulting scale values for the N.A.I.T. group were 
different than those of the University group (correlation of 
€.80), and obviously different than those for the combined 
groups. It was decided that because there was a difference, the 


scale values for the N.A.I.T. group would be utilized to 
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Table 2 


Scale Values for Combined Group 


Stimulus Number 
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Table 3 


Scale Values for Separate Groups 


N.A.I.T. Group U. of A Group 
Stimulus # Scale Values Stimulus # Scale Values 
(lowest to highest) {lowest to highest) 
Z -1.384 9 ss ENS) 
3 =e 2 15 1 atl ee 
*9 = hetes 3 =e OO 
5 -0.396 4 =), 483 
2 —9.214 2 Opes!) 
4 0.283 Wl 0.463 
y 0.428 5 Oso te 
*8 0.882 10 OSes 
6 0.948 3 1.308 
10 neers 6 1.461 


*Those two stimulus numbers chosen as samples for the study. 


determine the sample of in-service content to be developed, This 
decision was made because the N.A.I.T. group were basing their 
judgments on actual teaching experience, whereas the U. of A. 
students (potential instructors) were basing their judgments on 
perceived future teaching. The criterion used to select areas of 
content (modules) was generally this: They were to be relatively 
far apart on the scale, but at the same time not at the extreme 
ends; and to coincide with the relative content expertise of the 
researcher (the person to be employed as the instructor in the 
delivery of the modules). With these general criteria the two 
modules selected were Psychomotor Learning (#9) and Adult 


Learning (#8). These two modules best fit all the above criteria. 
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The Preparation of Modules involved many tasks, 
including: identifying the general format and time constraints, 
review of relevant literature, development of instructional 
objectives, identification of learning activities, the 
development of instructional plans and aids, and the preparation 


of the learning environment (procurement of space and 


instructional support hardware), 


It was important to conduct this study in a realistic 
environment. With the identification of N.A.I.T. as the 
experimental institution it became necessary to identify the 
conditions and constraints under which reality could be 
Maintained, The constraints as to format and time in this 
environment were the same for both modules, and these major 
contraints were: 1) each module was expected to "stand alone", 
that is to have no pre-requisite or Co-requisite specification; 
2) clients in the program would be selected by the process of 
advertisement within the institution and acceptance ona first 
come first serve basis to a maximum of twenty-five clients; 3). 
clients would be able to participate in the learning environment 
only within the time available during a regular work week, but 
outside of normal working hours; 4) and the total time available 
for learning within any one module would be limited to a total of 


twelve in-class hours, 


Each of the two modules was developed employing the 
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same procedures, The team approach to module development was 
considered but was not used in favour of using the researcher's 
content expertise as the major source of structure and content 
because of time constraints. The documents of the finished 
modules are outlined in Appendix A (Adult Learning Module) and 
Appendix B (Psychomotor Learning Module). These documents each 
contain the following Material: instructional objectives; 
instructional software (overhead transparency masters, handouts, 
etc.); pre and post tests (developed for the evaluation process 
discussed later); and a bibliography of the literature reviewed 


in the identification of the structure and content, 


The major task of reviewing the literature relevant to 
each of the two selected modules was undertaken with the intent 
of identifying relevant structure and content for each module. 
From this extensive review of literature the structure was 
outlined and matched with the stated goals of in-service 
education at N.A.I.T. to assist in the task of preparing the 


instructional objectives. 


Instructional objectives were prepared in a format 
Similar to, that, put forth by Gronlund (1970)... The “majority of 
objectives were specific at the application level within the 


coghitive domain. 


Following the preparation of complete instructional 
objectives was the preparation of lesson plans and instructional 


software. The large numbers of clients and the relatively short 
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period of learning time available influenced the selection of 
learning environments to be generally appropriate to large class 
presentations, The planned learning activities are described in 
detail in the section on the preparation of the evaluation model 
covering the intended transactions. Instructional software to 
assist in the presentation of the modules was prepared at this 


time, 


The review of literature in Chapter II described the 
structure of the evaluation model (Stake's Model) employed in 
this study. In “addition to this structure an operational 
framework had to be established to interface the evaluation model 
with the realities of the experimental environment. The tasks 
involved in this function are described with specific reference 
being made to the kinds of data to be collected and their 
relationship to the evaluation model. Specifically, this section 
identifies and describes how each instrument was developed and 
how it was employed in data collection. These descriptions 
reflect the refinement of activities first tested in the pilot 


study. 


The Rationale, The procedure for gathering data for the 


"rationale" of the evaluation model was to conduct a directed 
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interview with the person responsible for the development of in- 
service programs at the institution where the sample of subjects 
was identified. The interview was conducted with Mr. Les Morgan, 
Director of Research and Staff Development at N.A.I.T. The 


questions asked at this directed interview were: 


#1. In general terms what are the major reasons why an 


in-sevice program is being established at N.A.1.T.? 


#2. What are the major goals of the program? 


#3, Who will the program serve? 


#4. What general format do you envision the program 


should take? 


#5, What other comments regarding the rationale behind 


the program do you wish to make? 


Cell # 1 {Intended Antecedents), Data for the intended 
antecedent cell of Stake's model is categorized into three major 
classes: 1) a description of the intended clientele, 2) a 
description of the intended resource person Or personnel 
(instructors), and 3) a description of the physical resources 
intended to be utilized. The instructor collected this data by 


summarizing the advanced information under three headings. 


Cell # 2 (Observed Antecedents), Data for the observed 
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antecedents replicates the classifications described for intended 
antecedents. To collect data relevant to the description of 
clientele a “general biographical information" questionnaire was 
developed, Each client upon registration for the in-service 
module completed this questionnaire. A copy of this questionnaire 
can be viewed in Appendix D. Data collection for the purpose of 
describing the resource person required no special instruments 
nor any special technigues other than a summary of a curriculum 
vita. A simple check list was utilized to record data relative to 


the observed physical resources employed. 


ell # 3 {Intended The intended 
transactions, aS with the intended antecedents, required no 
special preparation of instrumentation. A detailed description of 
the transactions as envisioned within the logical contingencies 


between antecedents, transactions and outcomes was recorded prior 


to the delivery of the program. 


Cell # 4 (Observed Transactions). Results from the 
pilot study demonstrated that adeyguate recording of the 
transactions would be made by keeping up-to-date continuous 
records of the class activities (recording actitivies on a check 


list at short intervals), and by having subjects report “at home" 


activities. 
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Cell # 5 (Intended Qutcomes), Development of techniques 


to identify and record the intended outcomes amounted to the 
utilization of performance objectives and sequencing technigues 
as outlined by Gronlund (1970). The specification of objectives, 


then, amounted to the methodology employed for this task. 


The procurement and/or 


development of instruments for the task of making observations on 
the outcomes amounted to a major task. Instruments had to be 
developed to measure the extent of attainment of the only a 
Likert scale instrument was used for the Psychomotor Learning 
Mocule because the results from the pilot study showed no 
Slonificant difference from the results using a Paired Comparison 
instrument. The Likert scale instrument iS easier to administer 
and requires less time on the part of the subjects. fintenied' 
outcomes as described by the performance objectives for =ach 
module, Two general classes of instruments were developed: 1) for 
the measurement of cognitive objectives, and 2) LO the 


measurement of affective objectives. 


Measurement of the cognitive objectives of the Adult 
Learning module was accomplished with the preparation of a forty 
item multiple choice pre-test and a parallel form forty item 
multiple choice post-test. This was accomplished by preparing two 
parallel items at a time and randomly assigning one item to the 


pre-test and assigning the other to the post-test. All items were 
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read by several content experts for content validity, and 
modifications were made before assignment to either the pre or 
post tests, It was judged by these experts that the items 
adequately represented the content as described in the 
performance objectives, The measurement of the cognitive 
objectives of the Psychomotor Learning module was carried out 
with the preparation of a forty-five item multiple choice pre- 
test and a parallel form forty-five iten post-test developed by 
Similar techniques to that of the pre and post tests described 


above for the Adult Learning module, 


Measurement of attainment of the affective domain 
objectives of each module was accomplished by: preparing a Paired 
Comparison instrument and a Likert Scale instrument for the Adult 
Learning module; and preparing a Likert Scale instrument for the 
Psychomotor Learning module. Only a Likert scale instrument was 
used for the Psychomotor Learning Module because the results from 
the pilot study showed no significant difference from the results 
using a Paired Comparison instrument. Th2 Lik+rt scale instrument 
1S eaSier to administer and requires less time on the part of the 
subjects. Statements for each of these scaling instruments were 
selected from recent literature pertaining to the respective 
modules, Affective domain outcomes would be measurable by 
observing a change between pre and post administration of these 


instruments, 


This section has described the tasks involved in the 
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preparaion of the operational evaluation model with specific 
reference as to what instruments were utilized, and how they were 
utilized. Examples of all instruments used in the study which 


have been described in this section can be viewed in Appendix D. 


This section will describe the procedures carried out 
to deliver the two modules of in-service instruction to samples 
of instructors from N.A.I.T. The sample of instructors was 
selected by advertisement throughout the institution and because 
credit towards the pay scale would be granted to those who 
participated, the volunteers were considered representative of 
the population that would normally be involved in in-service 
programs. The sample for the two modules was the same and 
totalled forty-three instructors. Two factors made it necessary 
to split the sample of forty-three into two groups, one group of 
hineteen and one of twenty-four. These factors were: 1) no two 
evenings could be identified when all forty-three instructors 
could participate, and 2) forty-three instructors in one class 
exceeded the maximum number (twenty-five) specified in the 
intended antecedents. The group of nineteen instructors met on 
Monday and Wednesday evenings in June, 1974 for two weeks (four 
evenings for three hours each evening or a total of twelve 
hours). This group then met on Monday and Wednesday evenings for 


a subsequent two weeks and a similar total participation time for 
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the Psychomotor Learning module. The group of twenty-four 
instructors met on Tuesday and Thursday evenings (three hours 
each time) for four consecutive weeks for instruction in the 
Adult Learning module and the Psychomotor Learning module for a 
total of twelve hours respectively for each module. Specific 
details as to the exact involvement of the groups in the 
instruction appear in Chapter V (Results) because these data 
constitute a significant element in Stake's Model. of influential 
decision makers at N.A.I.T.'The results on observed antecedents 
describe the samples in detail; the results on observed 
transactions describe the specific interactions in classes in 
detail; and the observed outcomes describe the results of the 
performance of subjects in presenting a summary of all the data 
of the descriptive matrix and learning the objectives for each 
module, It was considered sufficient to report this information 
in the results, as it is an inherent component of the outcomes of 
this study and forms an integral part of Stake's model. 
Furthermore, the preceding section dealing with the preparation 
of the operational evaluation model has described the procedures 
ermployed in the gathering of the other related data at the time 


of delivering the modules of in-Service curriculun. 


The use of the evaluation model to evaluate the 


performance of the in-service Individual judgments were then made 
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and reported on a set of forms provided tor the purpose. Appendix 


E shows all the documents presented to the decision making group. 


curricula involved collection of data for the 
"standards" and "judgment" columns of th2= evaluation model. This 
is reported in the paragraphs that follow, grouped into cells 
representative of the evaluation model. The outcomes’ resulting 


from the administration of this model are reported in Chapter Vv. 


Celis 42 2 and 11 (Standards for Antecedents, 
Transactions ani Outcomes). The procedures for gathering data 
relative to the standards for antecedents, transactions and 
outcomes generally involved: the selection of a representative 
group of the d2cision makers from N.A.I.T., orienting this group 
to the tasks of 'standards' selection as dictated by the model, 


presenting the group with data from the pilot study as requested, 


and gaining a concensus opinion as to the standards to establish. 


The group selected was the five directors of N.A.I.T. 
who have no direct responsibility for tte planning of in-service 
programs, but who are keenly concerned with the programs because 
they represent the users of in-service programs. Also it was 
considered that this identifiable group is representative of 
influential decision makers at N.A.I.T. This small group was then 
brought together for the orientation, The orientation to the 


tasks involved presenting a brief overview of Stake's Model, 
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briefly describing the activities of the pilot study and the 
experimental study, presenting a Summary of all the data of the 
descriptive matrix and presenting suggestions on how to go about 
establishing standards, These suggestions included three main 
approaches: 1) identify the standards on the basis of absolute 
criteria from the consensus of this expert group; 2) recognize 
the results of the pilot study at Algonquin College as the 
criteria; or 3) recognize the previously described criteria as 
laid out in the "intended" column for the experimental study as 
the criteria. Once a group choice was made by the group these 
standards were then employed as the basis to make "judgments" 
about each of the two module offerings. Individual judgments were 
then made and reported on a set of forms provided for the 
purpose, Appendix E shows all the documents presented to the 


decision making group. 


Celis 8, 10 and 12 {Judgments). Judgments made by this 
group of experts were on many dimensions. Firstly, judgments were 
made as to the logical contingency of the experimental programs; 
secondly, judgments were made as to the congruence and empirical 
contingency of the experimental programs; and lastly, judgments 
were made as to the extent of success oft each program (module) on 
achieving) sthe) tasks Laid out “for. each of the antecedents, 


transactions, and outcomes. The adopted set of standards were 


employed to assist in this latter set of tasks. 
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To conduct a meta-evaluation it was decided to meld the 
thinking relative to Stake's model with that of the criteria 
suggested by Guba and Stufflebean (19790). Procedures to 
accomplish this included the following: 1) develop an instrument 
utilizing the criteria outlined by Guba and Stufflebeam, 2) 
procure the cooperation of the Same group of experts employed for 
making judgments re: the in-Service programs, 3) administer the 
instrument to this group of experts, anc 4) summarize and discuss 


the results of this instrument. 


The meta-evaluation instrument employed is a simple 
Likert type scaling instrument developed from the list of 
criteria found in the review of literature. This instrument was 
Simplistic by design in light of suggestions made in the 
literature regarding the importance of keeping meta-evaluation 
(second order evaluation) tasks simple and designed to meet the 
needs of the consumer (i.e. decision makers at N.A.1.T.). The 


instrument can be viewed in Appendix F. 


The instrument was administered to the same group of 
experts because they represent the appropriate consumers of the 
meta-evaluation, and they were previously made fully aware of the 
first order evaluation tasks and results. They responded to this 
instrument a short period after all the first-order evaluation 


tasks were completed. 
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Results fron the meta-evaluation activities were 
summarized and discussed by the researcher as the final task of 
the meta-evaluation, This Summary and subsequent discussion 


appear in the Results of the Study (Chapter V). 


This chapter has described the methodology of the 
study. This methodology was conducted in a sequence representing 
the following tasks: 1) developing a sample of modules of in- 
service curriula, 2) preparing an operational evaluation model, 
3) delivering the modules of in-service instruction, 4) using the 
evaluation model to evaluate the performance of the in-Service 
Curricula (a first-order evaluation), and reporting on the 


results of the meta-evaluation (a second-order evaluation). 


The procedures for each of these tasks were fully 
described and examples of each instrument employed were 
referenced to the appropriate appendix where each could be 
examined, Chapter V describes the results of each of these tasks 
in an order corresponding to the order in which they were 


presented in this chapter. 


CHAPTER IV 


THE PILOT STUDY 


The pilot study was conducted at Algonquin College in 
Ottawa during May, 1974. Algonquin College was selected for two 
reasons: 1) it has a similar array of programs and courses, and 
subsequently content expertise in instructional staff, to that of 
Neisi.f.; and 2) it is geographically renoved from N.A.1.T. to 
the extent so as to have prevented communication between subjects 
of the pilot study and subjects of the experimental group at 
N.i.1.T. A description of the methods =mployed and a summary of 
the data collected are presented here. It must be noted that this 
pilot study was designed to test the procedures up to and 
including the delivery of the sample rodules. It reports on the 
collection of data for the "descriptive matrix" of Stake's Model, 
but does not report on the results of the “use of the evaluation 


molel" nor does it report on the activities of "meta-evaluation", 


Selection of subjects for participation in the study 
was carried out by the Department of Staff Development at 


Algonguin College. They advertised across the five campuses of 
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Algonguin College to seek voluntary instructor enrollment to each 


of the two modules (Adult Learning and Psychomotor Learning). 


Descriptions of the subjects who enrolled in the two 
programs was determined from summarizing the data collected by a 
biographical questionnaire completed by each subject at the 
beginning of the program. These data correspond to the data 
collected for cell #3 of Stake's Model (Observed Antecedents). 
Tables 4, 5 and 6 Summarize the biographical data for subjects in 
the Adult Learning module; and Tables 7, 8 and 9 Summarize the 
biographical data for subjects in the Psychomotor Learning 


module. 


Table 4 


Summary of Age of Sixteen Subjects in Adult Learning Module 


Range (Years) 4% of Subjects 
20-24 0 
25-29 wae | 
30-34 37 
Bye eh) 18 
40-44 0 
45-49 9 

over 50 9 


Note: Mean Age = 34.5 years 
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Table 5 


Summary of Educational Experience Beyond High School of Sixteen 


Subjects in Adult Learning Module 


Range (Years) *” Of Subjects 
Less than 1 0 

1 8) 

2 0 

3 0 

4 55 

5 45 


Table 6 


Summary of Teaching and Other Work Experience of Sixteen Subjects 


of Adult Learning Module 


Teaching Experience 


Range (Years) Adult Teaching (4) Other Teaching (%) 
Less than 1 35 60 
1 6 0 
2 8 2) 
Es 8) 41 16 
5 Or more 15 19 
Other Work Experience 

Range (Years) *% Of Subjects 

jl er 10 

Sh ae 12) 12 

Sa 0 30 

10 or more 48 


Notes: Mean Years of Other Work Experience = 15,3 
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Table 7 


Summary of Age of Seven Subjects in Psychomotor Learning Module 


Range (Years) - Of Subjects 

205-24 0 

252= 129 29 

30 - 34 14 

30 a= 59 29 

40 - 44 0 

GS = 89 14 

over 50 0 
Note: Mean age = 32.7 years 

Table 8 


Summary of Educational Experience Beyond High School of Seven 


Subjects in Psychomotor Learning Module 


Range (Years) %® Of Subjects 
Less than 1 44 
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Table 9 


Summary of Teaching and Other Work Experience of Seven Subjects 


of Psychomotor Learning Module 


Teaching Experience 


Range (Years) Adult Teaching (%) Other Teaching (%) 
Less than 1 42 ae 
1 14 0 
2 C 0 
3 a5 39 14 
5 or more 14 14 
Other Work Experience 
Range (Years) % of Subjects 
t= 2 14 
Se Se ss) 14 
oe 10) 14 
19 or more 58 
Note: Mean Years of Other Work Fxperience = 10.6 


Transactions 


The intended transactions for each of the two modules 
was determined to be twelve hours (72C minutes) contact time 
broken into: a) sixty minutes to be used for data collection, b) 
sixty minutes to be used for feedback, Cc) approximately 240 
minutes to be spent in interaction in seminar activities, and qd) 
the cemainder (approximately 360 minutes) to be used for 
lecture/demonstration activities. In addition to the contact time 
(in-class time) it was anticipated that sixteen hours of "at 
home" activities would be utilized by each subject for: a) 


reading specified material (approximately thirteen hours), b) 
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reading other material (approximately on= hour), and c) studying 
or reviewing in-class activities (approximately two hours). These 
intended activities were outlined to best meet the objectives of 
each module (see Appendix A and Appendix BB) Within the 
limitations of time and environment established by in-service 
program routines at Algonquin College and anticipated constraints 


outlined; DYENAA. 1. T. 


The observed transactions for each of the two modules 
were recorded by a combination of: a) audio tapes of all in-class 
activities, b) instructor records maintained on a continuous 
basis, and c) reports of subjects regarding "at home" activities. 
Tables 19 and 11 summarize the data on these observed 
transactions for the Adult Learning module, and Tables 12 and 13 


summarize the data for the Psychomotor Learning module. 


Table 10 


Summary of Observations of In-Class Transactions for Adult 


Learning Module 


Subject Activities Minutes % of Total 
Listening & Observing 356 48.6 
Group Discussion 70 a! 
Practicum Activity 30 ee 
Informal Interaction 120 chores 
Data Collection WD 10.4 
Feedback ifs 10.4 


Total 72k 100 
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Table 11 


Sugmary of Observed "At Home" Transactions for Adult Learning 


Module 
Subject Activities Range (Minutes) 
Reading 0 - 430 
Other GC —7 50 
Total 6 - 440 
Table 12 


Mean (Minutes) 
pzaye) 
35) 


2990 


ba 


Summary of Observations of In-Class Transactions for Psychomotor 


Learning MOdule 


Subject Activities Minutes 
Listening & Observing 30C 
Group Discussion 420 
Practicum Activity 4s 
Informal Interaction fees 
Data Collection 60 
Feedback vhs 


Total Pas 


*% of Total 
41.7 
aot d/ 

(5 2 
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8.3 
10.4 
100 
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Table 13 


Summary of Observed "At Home" Transactions for Psychomotor 


Learning Module 


Subject Activities Range (Minutes) Mean (Minutes) 
Reading 0" = 265 140 
Other Oe as) 10 
Total CF = 70 I5e 
Results (Qutcomes) 


The intended outcomes for each of the two modules were 
stated to be a measure of growth (difference between pre-test and 
POSt=Lest scores on items representative of the stated 
objectives) on cognitive objectives; and a measure of growth 
(Change towards norm) on specific statements re: a view of "how 
adult students learn," and “how skills are learned" on affective 
objectives, The instruments used to measure outcomes on the 
Cognitive domain objectives were: 1) for the adult learning 
module - a forty item multiple choice pre test and a parallel 
form forty item multiple choice post test, and 2) for the 
psychomotor learning module - a forty-five item multiple choice 
pre test and a parallel form forty-five item multiple choice post 
test. These documents are found in Appendix D. Instruments 
developed to measure the growth on the Affective domain 


objectives were a Paired-Comparison instrument and a Likert scale 
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instrument for the adult learning module , and a tJLikert scale 


instrument for the psychomotor learning module. 


The observed outcomes are reported here - first for the 
cognitive domain objectives, and second for the affective 
objectives. A summary of the growth on the cognitive objectives 
is presented by: 1) reporting scores on the pre test, 2) 
reporting scores on the post test, and 3) reporting results of a 
test for signifiant difference between pre and post tests (t 
test) for each module. Table 14 reports the results for the adult 


learning module and Table 15 for the psychomotor learning modyle. 


Table 14 


Results on Cognitive Objectives for Adult Learning Module 


(Correlated t Test) 


Means: Pre Test Post Test 
XS TES 29.187 
Probabilities of t for Differences Between Variances 
1 2 
1 1.000 6.5834 
2 0.831 1.006 
Probabilities of t for Differences Between Means 
1 Z 
1 1.000 0.049 


Zz 0.049 1.0006 
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Table 15 


Results on Cognitive Objectives for Psychomotor Learning Module 


(Correlated t Test) 


Means: Pre Test Post Test 
17.86 24.41 
Probabilities of t for Differences Between Variances 
1 2 
1 1.000 0.138 
2 Omss 1. 000 
Probabilities of t for Differences Between Means 
1 2 
1 1.000 O17 
2 0,077 1,000 


A summary of the growth on the affective domain 
objectives amounts to the reporting of results of: 1) a Likert 
scale and Paired Comparison ainstrument dealing with seven 
Statements regarding adult learning, and 2) a _ Likert scale 
dealing with six statements regarding psychomotor learning. The 


seven questionnaire statements dealing with adult learning are: 


1. The adult student is likely to be rigid in his 


attitudes and beliefs. 


2. The adult student is generally impatient in the 


pursuit of learning objectives. 


3. The adult student tends to have difficulty in 
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remembering isolated facts. 


4, The adult student usually requires a longer time to 


perform learning tasks. 


Oe The adult student tends to be afraid of failure at 


the beginning of a new learning task. 


6. Adults are sometines fatigued when they attend 


classes. 


1s Adults are easily distracted by inappropriate 


(noisy, etc.) learning environments. 


Table 16 reports pre and post test results for the 
values assigned to the Likert scale (five point scale) on seven 


statements regarding adult learning. 


Table 16 


Pre and Post Ratings for Adult Learning Module From Likert Scale 


Instrument 
Statements: kD #3 #4 #5 #6 #7 
Pre Test Sais Bs Sshe Bois es Bere Balas Loa iOKele) By afte! 
Post Test Beh Sees. = 4etOy) a6. Peo0gs w.250 32833 


Note: Correlation between pre and post ratings = 0.946 
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Table 17 reports the pre and post test results for the 
ranking assigned the seven statements by the Paired Comparison 


instrument. 


The six questionnaire statements dealing with 


psychomotor learning are: 


1. People who have trouble in "academic" programs 


usually do very well in “vocational” programs. 


2. Motor skills can be learned very quickly. 


3. Compared to "cognitive" learning environments, the 
learning environment for the development of motor skills is 


better suited to individual learning. 


4, Trial and error techniques should be an integral 


part of the learning activities in skill development programs. 


5. Motor skills are harder to learn than cognitive 


Select 


6. Lack of motivation 1s not a problem generally 


associated with the learning of motor skills. 
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Table 17 


Pre and Post Ratings for Adult Learning Module From Paired 


Comparison Instrument 


Pre Test Rankings 
Stimulus Number 
PR eae es ces ps ease eee 
Peay tees ia orate ener cree 
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Post Test Rankings 
Stimulus Number 
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*** (0.105) 
6 
eK KKK (0,256) 
3 
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Note: Correlation Between Pre and Post Test Ratings = 0.774 
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Table 18 reports the pre and post test results for the 
values assigned to the Likert scale (five point scale) on the 


above six statements, 


Table 18 


Pre and Post Ratings for Psychomotor Learning Module From Likert 


Scale Instrument 


Statements: #1 #2 #3 #4 #5 #6 
Pre Test 2.143 2.006 SB) 4s) 35 WES Do Wh Pye Hf ih 
Post Test Zoo Pry ST) 3 4.143 459000 5 We PP Sey Sy I] 


Note: Correlation between pre and post test ratings = 0.925 


The general results of the pilot study conducted at 
Algonquin College have been reported here. Conclusions drawn from 
this study are many, The foremost conclusion 1S that data 
necessary for the operation of Stake's Model of evaluation can be 
gathered in the "real" environment. Several instruments and 
procedures were tested which, in general, proved to be 
operational and effective, The results of this pilot study were 


utilized for: assisting in the preparation of the evaluation 
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model; delivering the modules of in-service instruction ; and 
using the evaluation model to evaluate the performance of the in- 
service curricula (specifically to assist in establishing a 
standard required for the "judgment matrix" of Stake's Model). 
The methodology (described in Chapter III) for these tasks was 


perfected by utilizing the results of the pilot study. 
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CHAPTER V 


THE RESULTS 


The results reported in this chapter will be presented 
according to five headings, following the general format 
established in earlier chapters. These headings are: 1) results 
of sample curriculum preparation, 2) results of preparation for 
delivery of instruction, 3) report on the delivery of curriculum 
modules, 4) results of the evaluation of curriculum, and 5) 


results of meta-evaluation. 


In this study a sample of two modules of curriculum 
were developed and each of two groups of subjects was taught the 
content included in the two modules of curriculum. The two sample 
modules of curriculum have been labelled “Adult Learning" and 
"Psychomotor Learning"; while the two groups of subjects have 
been identified as the "Monday-Wednesday group" (M-W group) and 


the "Tuesday-Thursday group" (T-R group). 


Curricylum Development of Sample Modules 


The results for this portion of the study have been 
discussed previously in Chapter III. However, in review, there 
were two major results coming out of the activities of preparing 


the sample modules of curriculum. These results were to 1) select 
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topics and 2) specify, select, develop and document content for 
two modules of curriculum to serve as the basis for the 
experimental studies, The two sample modules selected were a) 
Adult Learning and b) Psychomotor Learning. The documents for 
these completed modules are included in Appendix A and Appendix B 


respectively. 


Preparation for Delivery of Instruction 


The preparation for the delivery of instruction yields 
data categorized within the structures identified by the Stake 
Model, Specifically, the results are reported for the categories 
of "Rationale" and for each of the three cells of the “intended 


column", 


The Rationale. Results of data collection and 


summarization relative to the "Rationale" of the Stake Model is a 
direct outcome of the directed interview with Mr. Les Morgan, 
Director of Research and Academic Development at N.A.I.T. The 
results of this interview are summarized and presented in 
paragraph form with identification of the kinds of questions 
asked and also with additional information offered during the 
interview, 

The major reason why an in-service program is 

being established at N.A.I.T. is that for the 

most part hiring of instructional staff 

employs selection criteria which are heavily 

weighted towards "technical content" 


expertise. It is subsequently felt that there 
is a need for each instructor to be able to 
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perform effectively as a teacher. 


The major goals of the total in- 
service program are to provide skills, 
knowledge, and an opportunity to develop a 
competency to perform effectively in the 
classroom or laboratory. fo meet this general 
goal pedagogical content (i.e. learning 
psychology, teaching strategies, curriculum 
development skills, etc.) constitutes the 
core of the progran. 


This in-service program will serve 
all instructional staff. Any instructor who 
has documented evidence that he or _ she 
possesses good pedagogical competencies can 
participate in the program on a voluntary 
basis. As can be seen by the format of the 
program, part is generally compulsory for all 
instructional staff. 


The general format of the progran 
is to have two general categories of in- 
service offerings. Category A would normally 
be compulsory and be directed at all new 
instructional staff. Category B would be 
voluntary and directed at all instructional 
staff. Category A will have a decentralized 
component (handled by the individal teaching 
departments) and a centralized component 
{handled by the overall administration of the 
Institution). The decentralized component 
includes orientation to the individual 
teaching departments with an opportunity to 
identify specific immediate needs prior to 
instructing, and attempting to meet these 
specific needs. The centralized component 
will constitute seven working days of general 
orientation to policies and procedures of the 
total Institution and its mandate to clients 
and industry. This component also includes 
instruction in safety procedures and first 
aid procedures. 


Category B of the total in-service 
program at N.A.I.T. has three components. One 
component provides recognition via special 
diploma for instructors who have developed, 
taught, taken or challenged courses or 
technical content within N.A.1I.T. A second 
component provides recognition and 
encouragement for completion of courses, 
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seminars, etc. offered at other institutions 

or in industry. The third component, more 

identifiable as a truly "in-service" prograag, 

is a comprehensive program of general and 

specific pedagogical content. (Researcher's 

note: This component of the total in-service 

program at N.A.I.T. is the component within 

which the sample of modules of curriculum 

were presented and studied.) The content for 

this component will be offered as credit-hour 

modules. A module is functionally defined as 

being independent of any pre-requisite 

relationship with other units of curricula 

(other modules). 
Ideally the in-service programs at N.A.I.T. should be changing 
towards competency based formats, remain flexible, and reflect 


ever apparent changes in need. 


Additional results relevant to the preparation for 
delivery of instruction are reported by focussing attention on 
data for each of the three cells of the intended column of 
Stake's Model, These data were generated as planning activity for 
preparation for instruction, and reflect the goals and procedures 


identified for the rationale. 


Intended Antecedents (Cell #1). The results relevant to 
cell #1 constitute a detailed description of the intended 
clientele, intended resource person, and physical resources 
intended to be employed, Generally the intended categories 
identified here were expected to be similar for both curriculum 
modules. That is, the same group of clients, the same resource 


person, and the same physical facilities were combined for each 


module. 
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A description of the intended clientele was identified 
by the researcher based on input from N.A.I.T., data from the 
pilot study, and general knowledge about the total instructor 
population at N.A.I.T. No special pre-assessment was carried out 
(in the form of pre-registration, etc.) to best simulate real 
conditions. It was felt that in most instances this would 
constitute the context in which planning for modular curricula 
would come about. Table 19 summarizes the data identified for the 


intended clientele populations. 


The resource person (teacher) identified to instruct 
for both modules was the researcher, Those qualifications of the 
instructor (researcher) pertinent to the tasks of instruction in 
the two modules, in the context of adult in-service instructor 


education are: 
Age - 34 years 


Education - B.Ed. in Industrial Arts, M.Ed. in 


Industrial Education, Ph.D. candidate in Educational Psychology 


Teaching Experience - two years in Jr.-Sr. High School, 


eight years in Faculty of Education, 


Planning and conducting several in-service programs, 


workshops, etc. in adult context over past five years 


Rapport - Previous good rapport with similar clientele. 
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Table 19 


Description of Characteristics 


Of Intended Clientele For Both Modules 


Number of Clients per Module = 25 


Age Range: 25 - 55 years, X = approx. 35 


Education: 
Completed High School 
Beyond High School 
less than 1 year 
between 1 year and a degree 
degrees completed 
Formal Pedagogical Instruction 
none 
some 
certified 
Experience: 
Teaching 
Adult 
none O* 
less than 1 year o% 
2 years 30% 
3 - 5 years 4O% 
5 or more years 30% 
Other related work experience 


1 - 2 years 19% 
3 - 4 years 30% 
5 -~ 6 years 15% 
= 68 years 15% 
9 or more years 15% 
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cal facilities identified for use with both modules 


constituted that facilty which normally was available 


in-service 


included: 


activities at N.A.I.T. Generally 


these 


for group 


facilties 


A standard adult classroom for 25 to 30 people 


Good audio-visual support 


Good environmental conditions 
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Intended Transactions (Cell #3). The intended 
transactions for each of the two modules was determined to be 
twelve hours (720 minutes) contact time. This total in-class time 
was intended to be augmented by an average of six hours (360 
Minutes) of individual “at home" activities. A breakdown of 
intended times for various transactions within the in-class 


activities follows: 


listening and observing 360 minutes 
group discussion 120 minutes 
practicum activity 60 minutes 
informal interaction 690 minutes 
data collection 69 minutes 
formal feedback 60 minutes 


A breakdown of the at home transactions intended is as follows: 


reading specified material 240 minutes 
reading unspecified material 60 minutes 
review of material for study 60 minutes 


Details as to the exact nature of each of these transactions are 


found in the module documentation in Appendix A and Appendix B. 


Intended Qutcomes {Cell #5). The results for the 
intended outcomes are unigue for each module. The specific 
instructional objectives for each module express in detail the 
intended outcomes, with the group criteria left to be established 
at the time of making judgments (specifically establishing 


standards for the outcomes). In addition to the specific content 


(cognitive) objectives for each module, affective outcomes were 
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expected. These intended affective outcomes were simply an 
anticipated change in the ranking of statements regarding beliefs 
about adult learning (for the Adult Learning module) and beliefs 
about psychomotor learning (for the Psychomotor Learning module). 
The intended outcomes, largely expressed as instructional 
objectives, are linked logically to the antecedent conditions and 
educational transactions which precede and influence their 
achievement and are to be assessed with reference to them. This 
relationship is akin to ensuring logical contingencies between 
the antecedents, transactions and outcomes as described in the 


descriptive matrix of Stake's Model. 


eport on the Delivery of Curriculum Modules 


In keeping within the framework of the descriptive 
Matrix of Stake's Model, the report on the delivery of modules 
constitutes reporting on the data collected for each of the three 


cells of the observed column. 


Observed Antecedents (Cell #2). The results of 
observations relative to the antecedents constitutes reporting 
the data collected for categories parallel to those categories of 
the intended antecedents, Data on the actual clientele is 
reported here in a parallel format to that of the intended data 
reported in Table 19, Tables 20 and 21 summarize these data for 


the two groups of clients utilized in this study. 
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Observed data relative to the description of the resource person 
is naturally identical to the data for the intended description. 
This is so because at the time of planning (identifying the data 


for the intended column) the resource person had been selected. 


Physical facilties utilized for each module also 


matched exactly those described in the intended columns. 


Observed Transactions (Cell #4). It is necessary to 
report the observed transaction data for each learning 
environment. Because there were two different modules of content 
and each of the two different groups of subjects were involved in 
each module, the transaction data are reported in four Tables. 
These are: Table 22, reporting data from the M-W group for the 
Adult Learning module; Table 23, reporting data from the T-R 
group for the Adult Learning module; Table 24, reporting data 
from the m-W group for the Psychomotor Learning module; and Table 
25, reporting data from the T-R group for the Psychomotor 


Learning module. 
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Table 20 


Description of Characteristics of 


the M-W Group of Clients 


Number of Clients = 19 


Age of Clients: Range % 
20 years and less 0 
20 - 24 years 0 
29) 29 years 14 
30 - 34 years 18 
35 - 39 years 18 
40 - 44 years 27 
45 - 49 years 14 
50 years and over 9 
x = 38.7 years 
Education: 
% 
Completed High School Ue 
Beyond High School 
Less than one year 18 
Between one year & a degree 32 
Degrees completed 50 
Formal Pedagogical Instruction 
None 79 
Some 16 
Certified 5 
Experience: 
Teaching 
Adult 4% Other % 
None 0 79 
Less than one year 0 0 
2 years S14 0 
3 => 5 years 36 0) 
5 or more years so 21 
Other Related Work Experience 
1- 2 years 11% 
3 - 4 years 26 
5 - 6 years 26 
7 = 8 years 21 
9 or more years 16 
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Table 21 


Description of Characterisics of 
The T-R Group of Clients 


Number of Clients = 24 

Age of Clients: 
Range % 
20 years and less 0 
20 - 24 years 0 
25 - 29 years ¢) 


30 - 34 years a2 
35°— 39 years 20 
40 - 44 years 8 
45 - 49 years 20 


59 years and over 2) 
x = 41.4 years 


Education: 
% 
Completed High School 68 
Beyond High School 
Less than one year 48 
Between one year & degree 28 
Degrees completed 24 
Formal Pedagogical Instruction 
None 76 
Sone 12 
Certified q2 
Experience: 
Teaching 
Adult % Other % 
None 0 83 
Less than one year 0 0 
2 years 29 0 
Jo> S8years 4y 4 
5 or more years 27 es) 
Other Related Work Experience 
1 - 2 years B% 
3 - 4 years 16 
Dee ayeacs 25 
7 °= 78 years Pp) 
9 or more years 22 
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Table 22 


Observed Transactions of M-W Group 


For Adult Learning Module 


In-Class Activities 


Activities Minutes % of Total 
listening and observing 400 56 
group discussion 60 8 
practicum activity 40 3) 
informal interaction 60 8 
data collection 85 12 
formal feedback Us 10 
Total 720 100 


At Home Activities 


Activities Minutes Minutes 
(range) (mean) 
reading specified material 0-300 UD 
reading unspecified material 0-60 13 
review for studying 0-150 37 


Total 0-310 86 
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Table 23 


Observed Transactions of T-R Group 


For Adult Learning Nodule 


In-Class Activities 


Activities Minutes %, Of Totad 
listening and observing 44d 61 
group discussion 45 7 
practicum activity 40 5 
informal interaction 60 8 
data collection 70 10 
formal feedback 65 9 
Total 720 100 


At Home Activities 


Activities Minutes Minutes 
reading specified material 15-280 180 
reading unspecified material 0-75 46 
review for studying 0-130 52 


Total 2-305 107 
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Table 24 


Observed Transactions of M-W Group 


For Psychomotor Learning Module 


In-Class Activities 


Activities Minutes %® of Total 
listening and observing 425 59 
group discussion 35 2 
practicum activity 70 10 
informal interaction 60 8 
data collection 60 8 
formal feedback 70 10 
Total 720 100 


At Home Activities 


Activities Minutes Minutes 
(range) (mean) 
reading specified material 0-480 138 
reading unspecified material 0-95 42 
review for studying 0-200 65 


Total 0-525 169 
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Table 25 


Observed Transactions of T-R Group 


For Psychomotor Learning Module 


In-Class Activities 


Activities Minutes PO te TOtal 
listening and observing 405 56 
group discussion 45 6 
practicum activity 75 Aa 
informal interaction 69 8 
data collection 69 8 
formal feedback aS) 11 
Total 720 100 


At Home Activities 


Activities Minutes Minutes 
(range) (mean) 
reading specified material 0-530 TZ 
reading unspecified material 0-115 56 
review for studying 0-180 83 
Total 0-571 204 


Tables 22 to 25 have reported the results of all the 
observed transactions. These results, along with the results from 
the observed antecedents and observed outcomes, constitute the 
total results on observations presented to the decision making 


group to be utilized for estimating empirical contingencies and 
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congruences within the descriptive matrix of Stake's Model. 


bserved Outcomes (Cell #6), Observed outcomes were of 


—S See eee Ce 


two general types: Cognitive outcomes measured as gain scores on 
multiple choice test items, and affective outcomes measured as 
change in the ranking between pre and post administration of the 


scaling instruments, 


The cognitive results (gain scores) for the two groups 
of subjects involved in the Adult Learning module are reported in 
Table 26 which summarizes a correlated t test administered on the 


results of the pre and post scores for +hese two groups. 


The results on the cognitive objectives reported in 
Table 26 show that for both groups (M-W¥ group and fT-R-= group) 
there is a statistically significant difference between means at 
alpha levels of 0,027 and 0.037 respectively. These are obviously 
both less than an alpha level of 0.05 which is selected as the 
decision alpha level for this data. It can be summarized for 
presentation to the decision making group that in fact for hoth 
groups of subjects there was shown to be a difference between 
means (positive gain) which is NOT attributable to sampling 


error. 


Table 27 shows similar data for both groups of subjects 


involved in the Psychomotor Learning module, 
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Table 26 


96 


Results on Cognitive Objectives By the Two Groups of Subjects 


For Adult Learning Module (Correlated t Test) 


Means 
Probabilities 


4 
2 
Probabilities 


1 
3 


Means 
Probabilities 


4 
2 
Probabilities 


1 
2 


M-W GROUP 


Pre Test 

PN A Tis 

for Differences 
1 

1.000 

0.408 

of t for Differences 
4 

1.000 

0.027 


T-R GROUP 

Pre Test 

22.64 

for Differences 

1 

1.000 

0.622 

for Differences 


(oye <2 


of t 


1 
1.000 
9.041 


Post Test 
PA SA 
Between Variances 
oe 
0.408 
1.000 
Between Means 
Vs 
8) 50) 727/ 
1.000 


Post Test 
263955 
Between Variances 
2 
Oniow 
1.000 
Between Means 
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0.041 
1.000 


pe - et 
CAay 


on Le we 


= Pai 7 
' ~~ 2 - 
2956( Get to eotor? ovy at i ein CO peas ry. 


co = 
ieta® + ba7 abodes} Pst naa 


A be 


a) 7 
woul 648 Aa ' 
Rep ag 


- 7 


” _ 
- ae hed ede fe i 
" ueeeitadiyhcl 
: a ‘ye laade oii Ww 3 
2eSq07 i164 , bw! f] ne Sah rh vl ._— 24) e f - 
U i Oy ww 


aor aT 


97 


Table 27 


Results on Cognitive Objectives By the Two Groups of Subjects 


For Psychomotor Learning Module (Correlated t Test) 


M-W GROUP 
Pre Test Post Test 
Means 19.45 26.50 
Probabilities of T for Differences Between Variances 
1 2 
1 1.000 Grecual 
2 5 I 1.000 
Probabilities of T for Differences Between Means 
1 22 
1 1.000 0.016 
2 0.016 1.000 
T-R GROUP 
Pre Test Post Test 
Means 19.82 26.41 
Probabilities of T for Differences Between Variances 
1 2 
1 1.000 9.304 
a 0.304 1.000 
Probabilities of T for Differences Between Means 
1 2 
1 1.090 9.019 
2 0.019 1.006 


The results on the cognitive objectives reported in 
Table 27 show that for both groups of subjects there is a 
statistically significant difference between means at respective 
alpha levels of 0.016 and 0.019. Taking again a decision alpha 
level of 0.05 it can safely be reported to the decision making 


group that the differences between means (gain scores) for both 
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groups on the Psychomotor Learning module (cognitive objectives) 
were not the result of sampling. The decision as to whether or 
not these are large enough has to be left to the judgment made on 
the basis of standards established by this decision making group. 
The results of the selection of standards for outcomes are 


reported in results for Cell #11 of Stake's Model. 


The observed data for affective outcomes is summarized 
as scale values derived from the Likert instruments. Table 28 
reports the scale values and correlations between scale values 


derived for the Adult Learning module outcomes. 


The results from the affective outcomes were consistent 
across groups of subjects and across modules. That is to say, in 
all instances there was little change between pre and post 
results. This is evidenced by the relatively high correlation 
between the pre and post results, the range being a low of 0.717 


and a high of 0.980. 


The employment of the evaluation model for decision 
making involved two main activities, Firstly, the selected group 
of decision makers were instructed to make estimates of the 


degree of: logical contingency, congruence, and empirical 
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Table 28 


Scale Values & Correlations From Likert Instruments 


For Adult Learning “odule 


5S 


Statements: 1 ez ) 4 5 6 at 
M-W Pre-test Beet 2et3? SSOS3 ~359s7e 8.105 635368) 25632 
M-W Post-test 3.579 2.737 3.947 3.842 4.368 3.789 3.421 
T-R Pre-test Se I9 202.790) 35108 351675733625 3.5838" 25782 
TR Post-test Be C2 ew ZOGy 4 6A 2D 835.5 ae Ite Sos meee, 
Correlation Between Four Sets of Scale Values 
M-W Pre M-W Post isn <ere T=k Post 
M-W Pre 1.000 0.846 
M-W Post 1,000 
T-R Pre 1.000 OR 
T= @Post 1.000 


Table 29 reports the scale values and correlations 


between scale values derived from the Likert instruments for the 


Psychomotor Learning outcomes, 


100 


Table 29 


Scale Values and Correlations from Likert Instruments 


For Psychomotor Learning Module 


Statements: 1 2. 3 4 5 6 
M-W Pre-test 8053 2.368 3.895 3.947 2.947 3.000 
M-#¥ Post-test 2.667 2.500 4.060 3.667 eo Onlt 36 a 
T-R Pre-test 2.583 2.292 3.875 2D UE) B, DEVE ISS 31g QSKe) 
T-R Post-test 2.440 2s BAG 35 DAe 3.880 2.560 3.240 


Correlation Between Four Sets of Scale Values 


M-W Pre M-W Post T-R Pre T=R Post 
M-W Pre 1.009 0.900 
M-W Post 1.00% 
Th ene 1.000 Osa 2 
T-R Post 1.000 


contingency. Secondly, this group was asked to create the data 
for the judgment matrix of the evaluation model. This constituted 


selecting standards, and based on these standards making 
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judgments about the two instructional activities. 


To facilitate these two main decision making activities 
a meeting of the five decision makers was called at which a_ set 
of documents summarizing pertinent information was given to each 
person, Briefly stated these documents contained: a description 
of the Stake Model, a copy of the rationale of the in-service 
programs at W.A.I.T., copies of all the summarized data for the 
six cells of the descriptive matrix for both sample modules and 
instruments for data collection. These documents contained 
summarized data and graphic displays to make examination of the 
data as easy as possible. The group was also given an opportunity 
to ask for clarification or additional detailed information. A 
copy of the documents distributed at this meeting is contained in 


Appendix E. 


To obtain results for the descriptive matrix three main 
questions were asked. Question #1 asked for an estimation of the 
degree of logical contingency that existed in the planning for 
each sample module. Question #2 was concerned with an estimate of 
the congruence between each level of the observed column. 
Question #3 related to an estimate of the degree of empirical 


contingency that was observed to exist. 


Hard data for Question #1 showed that on a choice of 
low, medium, or high as to whether there was an adequate logical 
Contingency the results were: low - no choices; medium - one 


choice; and high - four choices, Reporting these results on a 
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percentage basis shows that 0% chose the low category, 20% chose 
the medium category, and 80% chose the high category. It can be 
concluded that this group estimated that there was a high degree 
of logical contingency for BOTH sample modules. Additional 
comments were made by some of the group, and generally can be 
summarized by the following statements. “Generally the planning 
was well done with a good representation of the rationale of the 
in-service programs. There was definitely a good logical 
relationship between the antecedent, transaction and outcome 
cells, as should have been expected given the degree of previous 
information available to the planner (i.e. pilot study and first 


hand knowledge of N.A.I.T.)." 


Results for Question #2 are briefly summarized in Table 


SUG 
Table 30 
Estimate of Congruence for Both Sample Modules 
Adult Learning Module Psychomotor Learning Module 
Low(%) Med. (%) High(%) Low(%) Med.(%) High (4%) 
Antecedents 0 (0) 2 (40) 3 (60) 0 (0) 2 (40) S360) 
Transactions 0 (0) 3 (60) 2 (40) 9 (0) 2 (490) 3 (60) 


Outcomes 0 (0) 5 (100) 0-10) 9 (9) 3) (60) 2 (40) 
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It can be seen from results in Table 30 that there was 
generally a high level of congruence at all levels for both 
sample modules, There was a higher level of estimated congruence 
at the transaction and outcome levels for the Psychomotor 
Learning module. A Summarization of the general comments make by 
the decision makers is of special interest. "At the antecedent 
level congruence was high except for the instance of education 
beyond high school for the M-W group. It was observed that in 
this instance there would seem to be a higher level of education 
than expected. At the transaction level there was obviously a 
high level of control for the in-class activities and a 
relatively lower level of control over the at-home activities. 
This lack of congruence for the at home activities, however, is 
not very critical. Group interaction was observed to be less in 
all instances than was expected. This is not considered very 
serious because of the nature of the majority of the intended 
outcomes, Outcomes were observed to be generally congruent, 
partly because the specification of intended outcomes was not 


competency based." 


Results from Question #3 showed that empirical 
contingency was estimated to be high. Specifically the responses 
were: a) for the Adult Learning module: low - zero responses, 


medium - two responses, and high - three responses; and b) for 
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the Psychomotor Learning module: low - zero responses, mediun - 
one response, and high - four responses. These results were 
consistent for the M-W and T-R groups. Comments from the decision 
makers on this aspect of the results were very few. Generally 
they suggested that where there was any lack of empirical 
contingency it was due to lack of more specific or detailed 


observations on outcomes, 


The second major mandate of the decision making group 
was to establish standards and subsequently make judgments on 
each sample module program. Selection of the standards was 
accomplished by arriving at a group consensus, while the 
judgments were made on an individual basis using these common 


standards. 


The selection of standards was made from a choice of 
three possible sources, These were: 1) absolute standards 
developed in detail by the decision making group, 2) observations 
on all six cells of the descriptive matrix for the pilot study 
conducted at Algonguin College, and 3) the standards inherent in 
the specification of the three cells of the intended columns for 
each sample module of curriculum. The group consensus choice was 
to use the specification of the intended columns for each of the 
sample modules of curriculum, This choice was recorded on each 
members! set of decision instruments and subsequently utilized as 


the basis for individual judgment decisions. 


The judgment decisions are reported in Table 31. 
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Table 31 


Judgments For Both Sample Modules of Curriculun 


Adult Learning Module Psychomotor Learning Module 
YES NO YES NO 
Antecedents 5 0 5 § responses 
Transactions 2) 0 5 0 responses 
Outcomes 5 0 5 9 responses 


Note: YES - did meet standards 


NO - did not meet standards 


These judgment results are extremely consistent. This should not 
be surprising, since the decision making group had earlier 
estimated a relatively high level of congruence, and had 
subsequently chosen the intended column of each sample module of 
curriculum as the standards. General discussion with respect to 
the decisions was plentiful and in all instances made very few 
distinctions between the modules. These commentS are summarized 


by the following six statements. 


1. More detailed data on outcomes would have been 


useful. 
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2. If a data base for outcomes could be developed, 


these should be used as standards. 


3. The affective objectives were not outlined in enough 


detail in the intended column. 


4, A more detailed breakdown of intended and observed 
transactions would be desirable if more time could be devoted to 


establishing standards and making decisions. 


5. Pre test scores on cognitive objectives were higher 
than one would normally expect and perhaps this fact should be 


incorporated in the intended antecedents. 


0. I felt confident making a decision once the 
standards were established, however, I would have felt better 


about standards had we been able to identify a control program. 


— ee se ae Si eS ee ee 


After all judgments were individually made by the 
decision making group, they were asked to respond individually to 
an instrument designed to rate the worth of the "evaluation 
process" (the use of the model) that they had participated in and 
observed. This instrument was a Likert type instrument asking for 
responses in reference to eleven criteria chosen for rating 


evaluation procedures and models. In addition to making responses 
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on the instrument the individuals were asked to make additional 


personal comments about the evaluation process. 


The results from the Likert instrument are summarized 


in Table 32. 


Table 32 


Results of Meta-Evaluation (Likert Scale) 


1 2 S 4 5 Mean 
Low High 
Scientific Criteria: 
Internal validity 0 0 6 3 2 Gu 
External validity 0 2 0 2 1 3.4 
Reliability 9) 0 C 4 1 4.2 
Objectivity 0 0 C 2 5 4.6 
special Criteria: 
Relevance 0 0 G 3 2 4.4 
Significance 0 0 1 3 1 4.0 
Scope G C 3 2 0 3.4 
Credibilty 0 0 2 2 1 Sig 
Timeliness 1 1 1 1 1 3.0 
Pervasiveness 0 1 a 2 1 sl ys 
Efficiency 0 0 1 3 1 4.0 


A representative summary of the general comments made 
by the decision makers with respect to the "worth" of the 


evaluation model and process is presented here in point form. 


1. I would like an opportunity to try this model out on 
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some of our technology courses. 


2. A larger number of people from N.A.I.T. (i.e. 
Department Heads, for instance) should have been involved in the 


decision making process, 


3. The model really works, 


4, I would have preferred to have more time to digest 
all the information and perhaps have asked for additional 


information. Nevertheless I feel the system has worked. 


5. I would be very interested in having the Heads of 
Departments or Program Heads use this model to evaluate programs 
with respect to new instructors versus experienced instructors 
and the first guarter courses versus fourth quarter courses. [I 
feel the Department Heads would learn a great deal about the 


problems of being an instructor. 


6. I personally would like to try and use this model by 


being “in at the start" and help to specify the intents. 


Ts I have learned a lot about the problems of 
evaluation. This model seems to help resolve many of these 


problems. 


Summary 


Results of this study have been presented under five 
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major headings. This was done to sort out the various kinds of 
data and results inherent in this study wherein developmental 
stages of methodology were employed. Chapter VI will present 
conclusions which also relate to these five categories. 
Recommendations arising from this study will not necessarily 
follow this format. A summary of the complete study is presented 
at the beginning of Chapter VI, followed by the conclusions and 


recommendations, 
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CHAPTER VI 


SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


Summary of the Study 


The overriding problem of this study relates to the 
fact that post secondary institutions have been increasing 
rapidly in number and size, and subsequently, the numbers of new 
instructional staff required has been increasing rapidly. In 
addition, the hiring of instructional staff has emphasized 
technical competence in the subject area with little concern for 
pedagogical expertise. Furthermore, rapid changes in technology 
and the continuing push for improvement in pedagogical efficiency 
has placed even the experienced instructor in a position wherein 
he or she must bring new skills to bear on these problems. This 
has all resulted in the problem of providing good in-service 
programs for many, if not most, of the instructional staff of 
post secondary institutions, The problem was expanded by the fact 
that no documented system of evaluation was available for the 
monitoring of modular in-service programs. This study approached 
the problem in whole, with an emphasis on development and 
evaluation of an evaluation system. This purpose consitituted 
what has recently come to be known as meta-evaluation, the second 


order evaluation of an evaluation systen. 
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Because of the complexity and developmental necessity 
inherent in the problem, the purpose of the study was structured 


to adhere to the following sequence of requirements: 


1) develop a sample of modules of in-service curricula. 


2) prepare an Operational evaluation model. 


3) deliver modules of in-service instruction. 


4) use the evaluation model to evaluate the performance 


of the in-service curricula. 


5) report on the results of the nmeta-evaluation 
(effectiveness of the operational evaluation model for evaluation 


of modules of in-service curricula). 


The development of sample modules involved the 
selection of two topics (Adult Learning and Psychomotor Learning) 
and the specification of content from relevant and recent 
literature, In addition instructional support software for each 
sample module had to be prepared, Appendix A and Appendix B 
respectively contain the documentation for the Adult Learning 


module and the Psychomotor Learning module. 


Preparation of an operational evaluation model 
constituted the major task of searching the literature for a 
model to serve as the foundation, and subsequently, developing 
the operational procedures for the utilization of the model. The 


review of literature relative to curriculum evaluation systems 
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and models was included in Chapter II. The model selected was 
Stake's Model. Preparation for instruction of the two sample 
modules of curriculum was operationally controlled by utilizing 
the format of Stake's Model. In other words, the "Rationale" and 
the "Intended Cells" of Stake's Model identified the kinds of 


data and subsequent preparation that was necessary. 


The delivery of the sample modules constituted 
selecting two samples of subjects, each of which would be given 
instruction in each of the two modules; giving this instruction; 
and then collecting all the relevant data for the "Observed 
Cells" of the Stake Model. All data for the operational 
evaluation model were categorized into three main levels. These 
levels are antecedents, transactions and outcomes. At the 
termination of the delivery of the instruction data for these 
three levels for the intended cells and for the observed cells 
was collected. The instruments employed for this data collection 
are included in Appendix D. These data were summarized and 
incorporated in a set of documents (in the form of a report which 
is included in Appendix E) representative of the Descriptive 
Matrix of the Stake Model and was subsequently used for the 


judgment activities of the evaluation process. 


The evaluation of the performance of the in-service 
curricula constituted employing the activities of the Judgment 


Matrix of the Stake Model. 


Estimates of the logical contingency, congruence and 
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empirical contingency were made by a selected group of decision 
makers. This group was made up of five of the six Directors of 
the Institution, Their next task was to collectively select fron 
a choice of three, that set of standards upon which to base 
judgments about each of the three levels of data (antecedents, 


transactions and outcomes). These judgments were made. 


Following the completion of the judgment activities 
each of the persons from the decision making group was asked to 
participate in the meta-evaluation aspect of the study. This 
involved two activities: 1) responding to a Likert instrument 
which required an estimination of the worth of the evaluation 
model as measured against eleven criteria, and 2) making general 
personal comments as to their individual estimate of the value of 
this evaluation model. The meta-evaluation instrument is included 


in Appendix F. 


Results for each of the five aspects of this study were 
obtained. Two sample modules were selected and prepared. An 
Operational module was selected and according to the model proper 
preparation for instruction was completed. The modules of 
curriculum were given and all the appropriate "observation" data 
were recorded and summarized. A representative decision making 
group was able to make estimates about the relationships in the 
descriptive matrix of the model and they were also able to make 
judgments relative to the educational worth of each of the sample 


modules. Lastly, it was found that the decision making group was 
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able to rate the evaluation model against selected criteria and 
was able to make personal comments regarding their estimate of 
the worth of the evaluation model. In fact all the expected 


results of the study were attained. 


The following section will discuss the conclusions that 
can be drawn from this study, and following that a discussion on 


recommendations is presented. 


= ae ee ee 


As was presented in the summary of the study the 
expected results were obtained. This in itself constitutes a 
major conclusion; that is, it is concluded that all five aspects 
of the study were in fact capable of being carried out. Results 
were reported for each of the five aspects of the study. It 
remains at this point to assess the merit or value of each of 


these sets of results. 


The preparation of the curriculum for the sample 
modules was accomplished by the researcher by inclusion of 
content identified from the literature. This was adequate for the 


purposes of this study. 


Preparation for delivery of instruction involved the 
specification of data for each of the cells of the intended 


coluan with the goal of attaining good logical contingency 
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between these cells. This was accomplished and subsequently 
judged by the decision making group to be adequate. Additional 
specification of the outcomes, and specifically the affective 
outcomes, would have been desirable. The lack of specific 
intended affective outcomes was noted by the decision making 
group. Also more detail of the intended transactions would have 


been useful. 


Delivery of the two modules was documented by the data 
collection for each of the observed cells of the descriptive 
matrix. It was found that all data parallel to that of the 
intended cells was collected and summarized appropriately. 
Specifically the observed antecedent data were easily collected 
and summarized, The observed transaction data was all collected 
with a high degree of confidence that it was both valid and 
reliable, Validiy is estimated by the extent to which the 
observed data parallels categories established for the intended 
transactions, Reliabilty was estimated to be good on the basis 
that similar data for different groups was attainable, and 
corresponded with the expectations identified earlier. Observed 
Outcomes were measured uSing prepared instruments, It was not 
possible to select standardized instruments for this unique data 
collection task. However, the results of the pilot study, 
including an item analysis for the multiple choice tests and 
comparative results for two types of instruments (Likert Scale 
and Paired Comparison Scale) showing similar results, increased 


the researcher's confidence in all the instruments used. The 
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developmental stage of the evaluation process under study does 
not require that at this time standardized instruments be used, 
the major results at this time being that in fact the model does 
allow for and account for all the data that of necessity must be 
collected. Refinement and improvement of instruments to be 
employed within the model should, however, be considered wherever 


possible. 


The results for the utilization of the evaluation model 
for decision making are encouraging. Firstly, the decision making 
group was consistently able to determine that in fact a high 
degree of congruence did exist in both sample module offerings. 
The group estimated that there was for all levels (antecedents, 
transactions and outcomes) a relatively high degree of 
congruence. In addition they were able to estimate a high degree 
of empirical contingency for both offerings, The significance of 
these related conclusions is that the procedure employed was 
operational, and that each of the members of the decision making 
group felt comfortable with the procedure. The direct results 
obtained were evidence that the offerings had some merit; 
however, this conclusion is secondary to the conclusion that 


agreement was attainable. 


Further to the decision making process it was concluded 
that the processes of selecting a set of standards and making 
subsequent judgments was accomplished. A possible opposite 


conclusion would had to have had a “hung jury" with respect to 
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the overall and specific merit of the two modular offerings. In 
addition to being able to make a concensus decision as to which 
set of standards to use, there was obvious consistency in the 
subsequent individual judgments. Also, each member of the 
decision making group felt satisfied with the process, and in 
fact, in most instances was enthusiastic about the possibility of 


utilization of the process in the future. 


Conclusions relative to the meta-evaluation aspect of 
this study should be stressed. Upon examination of the results of 
the meta-evaluation instrument it can be seen that in general the 
process and model examined in this study was considered to be 
fairly highly rated on most of the eleven criteria. Certainly for 
all criteria except "timeliness" the ratings were above mid point 
(the average rating being above the 3.) rating). Ratings on six 
of the eleven criteria were at the 4.0 rating or above, with the 
criteria having the highest rating being “objectivity” (4.6). The 
relatively low rating on the "timeliness" criteria came about 
from an evenly distributed set of ratings from low to high. 
Subjective responses from the individual judges with respect to 
this criteria showed a wide range of different interpretations as 
to what context "timeliness" should be rated. Two judges felt 
that the evaluation of the in-service modules should have been 
made available to N.A.I.T. administrators much earlier. The other 
three felt that the model could function in a normal context in 
such a way to provide data in reasonable lengths of time. They 


did disagree somewhat as to what "a reasonable length of time" 
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was. Obviously the results relative to the worth of the 
evaluation process or model with respect to timeliness are 


inconclusive. 


In addition to the results on the meta-evaluation 
instrument there were many significant subjective statements made 
by each of the decision makers. Some relative conclusions drawn 
from these statements are: 1) the model as employed works well 
for attaining meaningful judgments about in-service modular 
programs, 2) i@provements in data collection will add to the 
usefulness of the model, 3) it would be expected that this model 
would operationalize and function in other evaluation contexts 
and most decision makers would like to try it in some of these 
other contexts, 4) the more experience a decision maker has with 
the model the better able he would likely be at using the model, 
5) if more judges were involved the results would probably be 
Similar but the effective impact of the decisions would be 


greater. 


The conclusions drawn from this study generally evolve 
to relate the overriding conclusion that, in fact, the evaluation 
model does function for the evaluation of in-service modular 
programs; and that it, in fact, rates fairly highly against 
universal criteria with respect to the overall worth of the 
evaluation tool. The recommendations that follow will attempt to 
suggest procedures and activities which would improve the rating 


of this evaluation model on these universal evaluation criteria. 


sheds <anvdeiour 
fur idee Goeplen> of | han 94808 24na etnequsa de 


qe iepeh) Soteqeiieal: “Hes” er eeepbhey \bwtpadnson rary a 


ade od Ghee (0019 noteoyl of O4 sfaegdverge) 11 ws i 


Iwhor acd 2on 
atas*oac aA TT 
a3 ba 
Po wad 2PO66 I 
0° iq ue ¢ 
‘héat 7 


ivigve: 921 4LGa ef 


Agrrehl sy 
Spill -se s@er 
Jed sane Ki of 


pat 4 't!. (2ene 


, bd 7 aed % AG = a3 iv ¢ » 
44° a8 ht i) GA ed Saul of iy 


av djeaten Fite borin Leyes aN: a 
a 


vi9e( 195 we? 


¥ a 
pa leagt ce. some ee Hae ail . 


dive Stu uesiein. were gh ws hak 


oe “et ; Tey Os 9S 4544 34 avy oun aad 4 
; ‘i a 


taps ined, «et, 


- ¢ 
wt Oye Gael. sant oeelann 


ne give fea ig Sag) 1 MEY ye ety Fo: connaibe 
odie gd be. PAe0R.) her ev jineofpeyege: © . 

‘ ry p@ih Ain@ vivoten antaisan Aaa bas 

| iedes 


rel 


; l¢ 
eo iter alae ERO RW NIGH, 9O*) H a4 tetas | ie 


b Si ‘ow hlas¥, ah oye yo! eg jaf” Gobou> ae ao 


0 
° 


: {= - 2 
pris ‘| py we ege Rh eenynr eney epic. tee oe ce 


Then npaievlionch 468 

iv end (eG byned-ppehineie ode nase 
mut ae 

) vlads 69" way it ne timwe? ree 

iasafaa uv ey APJ i ii , ada aaa 4 ; 

cep ies Seed pera dyiv. nie Font 


. 


4, 0 : ' 
3%) 


eC aie, La a 
v 


Recomnendations 


The recommendations from this study are presented in 
two groups: the first group dealing with recommendations that 
relate to specific findings in the study, and the second group 


reflecting a more overall relationship to the study. 


Specific Recoamendations 


1. Stake's Model aS it was operationalized in this 
study should be utilized for both formative and summative 


evaluation of in-service programs at post secondary institutions. 


2. Data bases’ should be developed upon which 
standardized instrumentation can be developed for all categories 
of data collection described by the operational model of this 
study. It is imperative that this be accomplished because at the 
present time there is relaively no standardized instrument 


available for this adult context. 


3. More specific categories of data for all cells need 


to be collected. 


4, Competency based testing should be employed for the 


measurement of outcomes. 


5. The utilization of techniques to analyze competency 
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based data (non-normative data) needs to be perfected. This is 
essential if truly modular programs are to be developed and 


evaluated. 


6. Group processes should be employed to assist in the 
initial development of curricula or, in other words, the initial 
specification of the intended cells in order to ensure a greater 


measure of relevance, 


7. %Data collection techniques for all stages of the 
evaluation model need to be streamlined so that reports, 
decisions and dissemination can be done as quickly as possible to 


improve the timeliness of implememtation of any results. 


8. A simple document which briefly describes the 
concepts and processes of the operational model should be 
produced to be distributed to all those involved in the use of 
the model. This document should be distributed to all those who 
might be involved at the beginning stages of an evaluation 


activity. 


General Recommendations 


1. In any adult eontere the operational evaluation 
model should be employed to negotiate content and process of 
programs with the learner clientele. It would be useful to have 
the adult clientele: examine their collective backgrounds and the 
other resources available (intended antecedents); determine what 


content or outcomes they would individually and collectively wish 
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to achieve (intended outcomes); and determine the learning 
activ: ties they feel are necessary to accomplish their objectives 
(intended transactions). The researcher feels the utilzation of 
the evaluation model in this fashion would result in optimum 
planning for any specific adult learning group, and would make 
formative evaluations of the program a rewarding and cooperative 
endeavor, The clientele would assist in the collection of the 
observed data and the preparation of a summary. It would still be 
advisable to have a “blue chip" group of deciSion makers to make 


any Summative evaluations which are deemed necessary. 


2. It is further recommended that formative evaluation 
conduc:'ted within the guidelines of the operational model employed 
in this study be an integral function of every curriculum 
development project. It is felt that this model is both effective 
and efficient, and above all, encompasses activities that give it 
impact. The fact that people from all levels of the educational 
institution (or a like environment) have roles to play in this 
process leads to the conclusion that the results of evaluation 
stand a good chance of implementation. One of the greatest 
payoffs of the use of this model is the enlightenment of all 


those involved. 


3. The operational model should be utilized in a 
variety of contexts and subsequent further meta-evaluation be 
conducted with the goal of improving the universal application of 


the model. 
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APPENDIX A 


ADULT LEARNING MODULE 
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Module #1 Adult Learning 


a. Each learner will be able to identify the essential characteristics of 
adult learners and be able to use this knowledge to help design and 
conduct good adult education programs. 


Activities Code 
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Instructional Objectives 


I Each learner will comprehend the essential charac- 
teristics of adult learners by being able to: 


II 


a) 


b) 


c) 


d) 


e) 


identify several generalizations about adult 
intelligence. 


identify the features of two major kinds of 
memory processes and how they typically operate 
within the adult learners; and be able to 
hypothesis as to which one(s) of the four 
theories of forgetting play a significant role 
in the forgetting patterns of typical adult 
learners. 


examine various hierarchies of learning sequences 
and specifically relate R. M. Gagné's 

"Conditions for Learning" to the immediate 
problems of curriculi being taught at the 
present time. 


discuss and criticize the general theories of 
motivation; and be able to relate Maslow's 
hierarchy of basic needs to the needs of typical 
adult learners. 


List, discuss, and defend several generalizations 
about the psychological characteristics of adult 
students you have worked with during the past 
year; and relative to these generalizations, be 
able to hypothesis some possible implications 
for designing and conducting adult education 
programs. 


Each learner will comprehend and apply the essential 
considerations relative to designing instruction 
for adult education programs by being able to: 


a) 


identify the sources of valid content for adult 
education courses. 
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b) select and help others select appropriate 
learning tasks. 


c) select and plan for a variety of valid 
instructional processes. 


d) prepare appropriate instructional objectives 
for adult learning programs. 


III Each learner will comprehend and apply the essential 
considerations relative to managing instruction for 
adult education programs by being able to: 


a) establish procedures and guidelines for 
appropriate guidance of adult learners. 


b) establish procedures and guidelines for 
appropriate feedback to adult learners. 


c) establish and maintain a learning environment 
suited to the characteristics and needs of 
adult learners. 
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Assigned Reading References 


ADULT LEARNING MODULE 


1R1 Intelligence and the Adult Learner. 
(Copy Included - 5 pages). 
1R2 Bayley, Nancy. "Growth of Abilities into Adulthood"; 


Analysis of Concept Learning, Academic Press, New York, 
1966, 164 - 173. 


1R3 Craik, F.I.M. and Masani, P.A. "Age and Intelligence 
Differences in Coding and Retrieval of Word Lists"; 


British Journal of Psychology, 1969, 60, 315-319. 


1R4 Charles, Don C. "The Older Learner". The Educational 
Forum, L971, 227 = 233; 


1R5 Memory and Forgetting. (Copy Included - 3 pages). 
1R6 How Do Adults Learn. (Copy Included - 4 pages). 
1R7 Adult Learning and Maslow's Concepts. (Copy Included - 7 pages). 


1R8 Creating a Good Climate for Learning. (Copy Included - 7 pages). 
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INTELLIGENCE AND THE ADULT LEARNER | Ry 23° 


The literature shows that psychologists differ rather widely as to 
the effects of age upon intellectual capacity or the power of the individual 
to learn. It shows also that there exists among the older people, as well 
as the general population, long-accepted sterotypes of the aging which 
tend to picture the older person as one whose physical and mental capacities 
are deteriorating and whose general interest in life is gradually diminishing. 
Kesearch up to this time has not been sufficiently extensive or intensive 
to give unequivocal evidence of the influence of age upon intellectual 
capacity. (5) 


Thorndike (4) some twenty-five to thirty years ago did considerable 
research on the question and his conclusions were as follows: 


1. The acme of ability (to learn) is reached at some point between 
twenty and twenty-five years of age. (See Figure 1.) 


2. There is a decline in capacity for learning from the acme (twenty 
to twenty-five years) to about forty-two years of age of from 
13 to 15 per cent, or approximately one percent per year. 


3. ine influence of intellect upon the curve of ‘ability to learn in 
relation to age is very slight. The ablest man and the ordinary 
man show very nearly the same curve. 


4, Individuals on the average probably learn much less from twenty- 
five to forty-five than they did from five to twenty-five. This 
is attributable to various combinations of four factors: general 
health and energy, ability to learn, interest in learning, and 
opportunity for learning. 


5. By the age of twenty-five most persons have, withint certain 
limitations, learned a great deal of what they wish to learn. 


Following World War I, Jones and Conrad (2) administered the Army 
Alpha Tests to 1,191 unselected rural New England subjects from ten to sixty 
years of age and when the results were plotted against chronological age it 
showed rapid intellectual growth to about sixteen years, a negative accelera- 
tion to about eighteen or twenty years, and a gradual but steady decline there- 
after. The performance at the fifty-five year level was about the same as 
that of the fourteen old. The subtests on vocabulary and general infor- 
mation failed to exhibit a post-adolescent decline, as did the other tests. 
The most rapid decline was found to be analogies, common sense, and numeri- 
cal completions. Jones and Conrad concluded that the tests on vocabulary 
and general information were the least valid indications of intelligence, and 
considered their findings as confirming Thorndike's conclusions--that intel- 
ligence declines steadily beyond the age range twenty to twenty-five years. 
They also concluded that speed was an unimportant factor in the measurement 
Dreintelligence. 
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voulds and Raven (1) administered the 1938 Progressive Matrices and 
the Mil! Hill Vocabulary Scale to 1,047 engineers and 920 male employees 
of an industrial firm--one competitive and one non-competitive in situation. 
The rat: of decline in the Matrices Test was uniform from age twenty-five 
on; the vocabular scores showed a constant rise to about thirty, with little 
decline to age sixty. On the basis of this they concluded: 


1. The average person's ability to form comparisons and reason by 
analogy increases rapidly during childhood, reaches its maximum 
at about age fourteen, remains constant to about age twenty-give 
and then declines steadily to age sixty and then more so to eighty, 
at which age the average person can reason by analogy about as 
well as an eight year old. 


The ability to recall information increases normally up to age 
twenty-five and remains constant for twenty-five to thirty years. 


Niles and Miles (3) cite the results of intelligence tests by many 
investi,.tors as giving what they consider to be clear-cut evidence of the 
followin;:: 

1. Score decline from young adulthood to old age. 


Greater decrement of "speed" versus "power" of intellegence. 


\. Better preservation with age of the verbal as compared with the 
mathematical and manué1 functions. 


4. Wide individual differences in score at every age. 


Iu connection with age-score curves on intelligence tests, Miles 
makes th: following observations: 
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1. If speed of reaction or youthful vigor is essentially involved 
in the test performance, decrement begins to appear early in 
adulthood, is continuous;- and tends, in later age, to become 
excessive. 


2. On the untimed, or "power" tests of intelligence, score decrement 
occurs with age, but the rate of decline is slower. 


3. The average decade scores of men and women are generally about 
equal whatever test is used, and they describe about the same 
decrement curve. 


4. At every adult age the best and the poorest scoring 25 per cent 
differ from the average by an amount that is more than three 
times the usual decade to decade loss. 


With respect to learning, Miles points out that learning ability is 
closely correlated with intelligence. He says that training utilizes capacities 
and practice maintains them. Measured ability to learn is maintained 
slightly better than the capacity to do mixed problems of the intelligence test 
type. If learning were required of all people in all subjects, the decline of 
competence with age might be similar to that of intelligence test capacity. 
Since learning is selective, however, and generally follows interest, the 
waning of capacity is retarded by the favorable factors which motivate the 
choice of material to be learned. 


Learning obviously depends upon attention, retention, and recall, 
says Miles. That these separate elements show greater decline with age than 
does learning itself simply means that in the latter other factors are also 


involved. Wanting to 1e@ann is, the preatest aldito learning. Interest in 
the subject to be learned aids in the mental organization necessary for atten- 


tion and retention. Attitude, interest, and motivation are better sustained 
as age advances than is the speed of activity, and they tend to channelize 
and conserve effort in the direction of organized patterns of experience. 

In childhood, active, varied learning is the rule; in maturity, active 
Hearning is usually practiced in areas defined in terms of interest. 


There is no veto power over learning exercised by age at any period 
in the normal life span, according to Miles. While experimental psychologic 


results are in agreement in indicating age decrements in adult learning, at 
the same time they definitely support the formulation that no one is ever 
boo Old to learn. 


Donahue (6) makes the following eight observations with respect to 
intelligence and learning in the aging: 


1. The general age curves for psychological functions are parabolic 
in shape. 


2. The same abilities decline at different rates in different persons. 


miriimAe’® O064 


Lidl ars ps 


am 


Meas oe ay) 


pe hy ov? te soteug Ut oaks 
jee 00 tends ete. oo 


thes ju) I pee 1 eohey <4 Si ARE WO Ne, tte ARS 
jvomeeon #2 vet tara Gi QV egarers O73 Bat) 
i) ghee er aheowh teu at 


yehi itp jel egak, lon, sve OR wo! AT, gnievant ad) See ad, 
i) Bsc ew? se ey 746 aw we amags fis ied dale baxat 
ab ve t (Se )ONaasH = (td enbb olin 


ein 


an? 11 sae 


cbotieei soot St Vet Hamidne) Goedel, Op od) Yalteeas #42 aeds 


aides tr ,pdake tae Eis 1) -ptebe Shad te Semgpes, aise pabranat § Age 
6) 486% St @ Gs Pi, 14 Jaded! P| +a Ligue ‘0 trigtn age ¢ 


bAl , Caanel. % . oy tog Dede , evoWod , e+) d>elpe) et besa ¢ 
ei i bethio’, Gideoekat, ett ce bit oe a + 
Soviet ed | On iastedie 48) 


Casing > gotyeet @ pPglocerie dpa gitar de bvde ga 

mAs SOR Aviad penrin'eh a | Wille gavel is °36.6 908 “ened [ tact 

vila 394 ry jas (Vat rpiceal ate OF Ja) thew 4 mpiee biearh 

sc Anbweted «NSE! Oo at Memspsetn 26? 3 _itiael eal 22, SES 
white 34) Tiaereees Ohh tne ee Se whie Dame hwo 

ro rdie lane tes ee en re \ 0 0D Ve.0 det 9g SOW StRs ued 1A Rats 

palfanbaen od hand Gale te es Oem 2S b45q8, 293 #) muy 

ssaske~uew Ra tratany bes tiagin bq ngtsoenl® eft ol 2oélia. 

cor san.,usinidea'al joe? 001 a gaiecuss baloey , owe tan) | 

pac paehe fy wei wt 4p rah sada “f Gap baa vi Leven at gi 


— _ 
- 


Bait: all ys is . $4® Ts. yrr ie i i’ a 2 S70 rong ’ 
£90 ibeor an! se to a0 x wets, o3 gnibecssea -,oe¢e 9 
in qulaeeet 01/40 a? eee ob agp gabiaz. bi: 2 ea eiIgs 

at) t3pggqua vistinie 


rit inciaeee 
a > ats'd . 


= . 
> 


an 


ga ** fs oo ai yam cabal ies 


ind Cemgew BsaW) Gubeieteedo sdgee qatwaliat Pere tT (@) ss 


, tac iga guts Mt puget 


nfledsde>. #ie- aval Oite® lanige: vea94q 38) Sevres oye 
a ZZ 


eset TT Thy ti) MO ee milion) enbaitin, 
1° ay 


. a 


133 


Judgment and reasoning ability reach their peak latest of all 
ebili ties. 


Age differences and age changes have frequently been confused. 


There is good evidence to support the view that the greater the 
individual's intellectual endowment and the greater the amount of 
education, the less steep is the decline in intellectual ability, 
other things being equal. 


Exercise of the mind seems to retard deterioration of intellectual 
processes. 


If minds are kept active through exercise of intellectual and 
creative imagination, outstanding achievements in fields not in- 
volving physical powers is possible in the seventh and perhaps 
even the eighth decade. 


The older adult can continue to learn meaningful things; compre- 
hension of difficult reading shows little or no change with age; 
but there is a decline in ability to remember isolated facts. 
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MEMORY AND FORGETTING 1 R S 


Memory 


Memory is the storage of learned material in the brain until such 


time as it is needed and it functions on two levels: 


1. Short-term memory - which retains learned material only briefly 
such as is the case when we look-up and dial a telephone number. After a 
few moments in the short-term memory system the learned material is either 
transferred to the long-term memory or forgotten. This memory system is 
limited in the amount of material it can hold at any one time but over the 
years it processes a vast amount of material. Because of this, age tends 


to influence short-term retention. 


2. Long-term memory - is the more or less permanent depository 
for learned material from the short-term memory system. In order for 
material to be retained and available for use a memory trace must be 
established, consequently instruction must be designed so as to establish 
fais trace. 

The long-term memory system operates in two different ways: 

1. Recognition memory through which we are able to recognize 
previously learned material. 

2. Recall memory whereby we are able to reproduce or reconstruct 


material that has been learned. 


Recognition memory has a greater capacity than does recall memory. 
This is readily evident if you think of the differences between your reading 
and listening vocabulary and your speaking or writing vocabulary. 

Because all experiences may become part of the memory, older adults 
have more material stored in the long-term memory than do those younger; 
consequently, it is more difficult to remember specific learned material 


guickly. 
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New material should always be learned in the way it will be needed for use. 
Thus, an item that will be used in isolation should be learned in isolation and 
that used in series should be learned in series. Furthermore, much of the 
material learned will be needed only through recognition so it should be 
taught for recognition rather than for recall. 

Since use affects retention, it is crucial that all new material be 
put to use immediately as it is learned. Through the use of new learning we 
can help establish the memory trace that will aid in remembering. The best 
time to learn anything is immediately before it is required for use. 

Finally, material is learned and retained better if the new material 
is perceived as meaningful to the learner. Meaningfulness is achieved when 
the learner understands the material, can see its relationship to what has been 
learned previously and to his goals or objectives, or when it is aware of its 
practical utility to himself. Because adult learners have a vastly greater 
prior knowledge and experience it is easier to establish the meaningfulness of 
new material. Group discussion is a particularly useful way of establishing 
meaningfulness with adult learners. 

In adults we encounter a particularly difficult problem with respect 
to the interference effect of prior learning. Material once learned and 
forgotten may interfere with new learning. If a new skill to be learned is 
similar to a previously learned skill the previous learning will impede the 
new learning ., In such a case, it may be necessary to devote time to unlearning 
the old before the new can be mastered. This problem is rarely encountered 
among the young but is frequent amount adults. It also may explain some of the 


difficulties adults have with certain learning tasks. 


Forgetting (summary) 


1. When we remember something we may show the marks of earlier memory 
in several ways. Redintegrative memory, or the recollection of a personal 
event, reconstructs a past occasion not only in terms of its content, but 
ef its setting in time and place. Such rich memories have been little studied 
in the psychological laboratory. Much easier to test are recognition, requir- 
ing only a sense of familiarity, and recall, requiring a reinstatement of 
something learned in the past. Saving in relearning is another test for the 


mor luence of prior learning. 
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2. The course of forgetting has been studied chiefly for material 
learned by rote, or, as we say, committed to memory. The most usual form of 
the curve of retention is that of rapid forgetting at first, followed by 
decreasing losses. The form holds for different sorts of materials, but 
the time axis differs. About as much forgetting or non-sense syllables may 
occur in a day as occurs in a year from the more meaningful substance 
Bea college course. 

3. Under some circumstances there is an initial rise in the curve of 
retention. A retention curve of this form-the rise before the curve begins 
to fall-is called a reminiscence curve, without implying an explanation of 
"reminiscence". 

4. Four theories that seek to account for forgetting have been proposed: 
(1) the theory of passive decay through disuse, (2) the theory of systematic 
distortions of the memory trace, (3) the theory of retroactive and proactive 
inhibition, and (4) motivated forgetting (illustrated by repression and the 
effect of goal tensions on retention). 

These four theories are supplementary, rather than contradictory, 
and each calls attention to important features of forgetting. The memory 
trace is purely hypothetical, and has not been identified in the nervous 
system. 

5. Most of the improvement in retention comes about through improved 
methods of fixating the material in the first place, and in part through 
practice in Pecan. It is doubtful if there is any change in basic retentivity, 
though little is known with any assurance about the nature of this underlying 
basis for memory. | 

6. The rapidity of memory, loss is lessened by actiye recall during 
learning, by periodic reviews, and by overlearning beyond bare mastery. 


Logically understood material is retained much better than material learned 


by rote. 
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HOW DO ADULTS LEARN? 


"We learn by doing." 

"Experience is the best teacher." 

Slogans like these have more than a germ of truth in chen. They 
represent wisdom distilled from human experience over a long period of time. 

Learning is change - change in an individual's behavior. Behavioral 
changes do not truly become a part of a person until he has reinforced them 
through use. For example, a student can memorize the operation of a piece 
of equipment or a new word for his vocabulary. But he doesn't actually "learn" 
those things until he practices operating the equipment or using the new word. 
The student, in short, must be involved in the process of learning. 

Motivation probably is the most important element of learning. 
Motivation is the drive which forces a person to move toward a goal. It makes 
a student want to know, to understand, to believe, to act, to gain a skill. 

Most adult students are self-motivated; they attend an adult class 
because they want to, not because they have to. Yet, because many adults 
doubt their ability to study and learn or because they fear exposure and 
ridicule, they need constant re-motivation. 

A teacher must recognize the importance of motivation and find ways 
to bring motivation factors into the learning process. Some of these factors 
are: the need for security, the need for new experience, the need for 
recognition, the need for self-esteem, the need for conformity, and the need 
to help others. 

The Laws of Learning 

There are a number of very basic psychological laws which control 
and affect student learning. If you hope to achieve any real measure of 
success in teaching adults, you must understand these laws. Using them, you 


can make the learning experience more effective, lasting, and enjoyable for 


Students. 
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The law of effect - People tend to accept and repeat those responses 
which are pleasant and satisfying and to avoid those which are annoying. If 
an adult enrolls in a course expecting to learn a new skill, for example, and 
quickly finds that he is learning it and enjoying the learning process, he 
will tend to want to keep returning to class. Moreover, he probably will 
want to enroll in more courses upon completing the first one. In short, 
"Nothing succeeds like success." You can help your students experience some 
personal satisfaction from each learning activity and achieve some success in 
each class period as you help them master a new idea or operation. 

The law of primacy - First impressions are the most lasting. This 
means that those first classes are all important. Early in the course you 
will find it helpful to arouse the students' interest in the subject matter 
by giving them an opportunity to discuss their need for the course. You will 
also want to be sure that the students learn the content right the first time. 

The law of exercise - The more often an act is repeated the more 
quickly a habit is established. Practice makes perfect - if the practice is 
the right kind. Practicing the wrong thing will become a habit too - one that's 
hard to break. You should be sure that your students are performing an operation 
morrectly. 

The law of disuse - A Beil not practiced or a knowledge not used 
will be largely lost or forgotten. You should recognize the value of repetition 
for reinforcing newly gained knowledge or skills. Studies have shown that the 
period immediately following the learning process is the most critical. 
Important items should be reviewed soon after the initial instruction. 

The law of intensity - A vivid, dramatic, or exciting learning 
experience is more likely to be remembered than a routine or coring experience. 


This does not mean the classroom should be a circus or a theatre-in-the-round. 
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But, on the other hand, the teachers whose subjects are longest remembered 
are those who had the ability to "bring their subjects alive." By using 
vivid examples and other supporting material, your teaching can be dramatic 
and realistic. 

Blocks To Learning 

In addition to the psychological laws of learning mentioned above, 
there are feelings, emotions, and attitudes in students which may be blocks 
to learning. Some of these cannot be controlled by you but the following 
ones can: 

Boredom - The work may be too easy or too hard. The teacher may have 
failed to motivate the students or to keep their attention. 

Confusion - The teacher may create confusion by presenting too many or 
overly complex ideas. Contradictory statements or failure to relate one 
step to another also can confuse students. 

Irritation - Annoying mannerisms of the instructor, poor human 
relations, interruptions, and delays can create this block. 

Fear - Fear of failure, of ridicule, or of getting hurt are common 
blocks to learning. It is important to make sure that each student shows some 
success in each session. 

Human Relations And Learning 

Student emotions come out in many ways, and it is important for 
the teacher to recognize these ways. Some of them are: Projection (finding 
someone else or something else to blame for a weakness - maybe the leader), 
rationalization (finding an explanation which sounds reasonable but does 
not get to the real base of the matter), aggressiveness (anger, contempt, 
discourtesy, loudness), flight (escape from a frustrating situation. . 


finding an excuse to stay away from class), resignation (giving up ...showing 


little or no interest in the class). 
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You can help overcome many of these blocking mechanisms by following 
four basic human relations practices: 
1. Help students set reasonable standards for themselves which they 
can achieve. Most people want to be better than average but, 
obviously, this is impossible for all if there is to be an average. 
The teacher should help the student identify those isolated areas 
in which the student excels and help him realize that satisfaction 
gained from competence in one area makes up for average ability in 
another. 
2. Help students help themselves. Students sometimes flounder, 
become frustrated and turn to the teacher for help. The teacher 
then should be warm and understanding but help the student figure 
out the difficulty for himself - not work it out for him. This 
offers an opportunity for development on the part of the student. 
3. Keep students informed. Share with your students the plan for 
the entire course so they will know what is going on and what to expect. 
Seeing the big picture helps them understand each part of it. 
4, Encourage the students to tell you how they see you as a leader 
of the learning group ...ways in which your teaching methods are 
helpful . . .and ways in which you could be of still more help. 
Finally, in adult education, the Golden Rule holds as true as ever. 


Treat your students as you, an adult, wish to be treated. 
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ADULT LEARNING AND MASL@&'S CONCEPTS 


I. Maslow's Psychology of Being 


The Problem as Seen by Mas low 


The problem of therapists and teachers is one of helping adults to 
become what they can and deeply need to become - mature, self- 
actualized, fully-functioning humans. 


Underlying Assumptions and/or Propositions 


ik 


Each of us have an "essential inner nature which is instinctoid, 
instrinsic, given, ‘natural''' in the sense that it has an appreci- 
able unchanging hereditary determinant (4: CH. 7). This inner 
nature includes instinctoid basic needs, capacities, talents, and 
physiological and neurological givens. ''This inner core shows 
itself as natural inclinations, propensities or inner best." 

G5 tap ae LoODE 


This inner nature and its potentialities must be seen develop- 
mentally. It is actualized, shaped or stifled by culture, family, 
environment, learning, etc. 


This inner core of impulses is weak and easily overcome or repressed. 


Each person's inner nature is in part idiosyncratic and in part 
shares its characteristics with all humans. 


It is possible to study this inner nature scientifically and 
objectively. 


Many aspects of this inner nature are either: a) actively 
repressed because they are feared or disapproved of, or are 
b) positively forgotten. 


Though weak and suppressed this inner nature rarely dies. "It 
has a dynamic force of its own pressing for open uninhibited 
expression. This force is fundamental to the urge to grow, the 
pressure toward self-actualization, the quest for identify. 

It is this that makes .. . education and self-improvement 
possible in principle." (5: pp. 192-3). 


This inner self grows partly by discovery of its biologically- 
based potential and partly as a consequence of the choices made 
by the individual. ''The person, insofar as he is a real person 
is his own main determinant." (5: p. 193) 
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If the essential core of a person is frustrated, denied or sup- 
pressed sickness and/or regression results. 


A person's inner nature is neither "evil" or "good" it is "prior 
to good or evil." 


Intrinsic guilt is necessary as a guide for growth toward actuali- 
zation of the seit. 


"evil" behavior, e.g. indiscriminate destructive hostility, is 
reactive. Angry behavior is not "evil" when the external situation 
warrants it. ; 


Primary process cognition, regression can be good, beautiful and 
desirable. 


For psychological health it is essential that the inner nature of 
a person be sufficiently accepted, loved and respected by others 
and by himself. (Note: the converse is not necessarily true). 


It is best to encourage, or at the very least, to recognize this 
inner nature. While recognizing a need for a balance between 
Spontaneity and control, Maslow feels that social and natural 
controls are "transcended and became aspects of spontaneity" in 
the self-actualized person. Such transcended controls "do not 
call into question the desirability of the gratification but 
rather enhance pleasure by organizing, estheticizing, pacing, 
styling and savoring the gratification". (5: p.198). 


Given free choice, a healthy person will choose what is good for 
his growth. 


" . , . the main path to health and self-fulfillment for the masses 
is via basic need gratification." (5: p.199). 


Complete absence of frustration, pain or danger is dangerous. 

To be able to perceive physical reality, to be cognizant of our 
strengths and limitations, and to be able to love and yet enjoy 
the loved one's need-gratification as well as one's own requires 
the acquisition of frustration-tolerance. 


Capacities as well as health organs and organ systems "need" 
to be used and exercised if an individual is to grow. 


An aspect of health is the ability to accept the existence of, and 
live in, both the natural and the psychic worlds. 
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Immaturity from a motivational standpoint is the process of gratify- 
ing the deficiency-needs, (security, belenging, self-esteem) in 
their hierarchical order. Maturity, or self-actualization, is a 
tranuscendance of these deficiency needs. 


Immaturity can also be differentiated from maturity in terms of 
cognitive, emotional and motivational capacities - i.e., D - 
cognition, D - love and D - motivation are characteristic of 
immaturity while B - cognition, B - love and B - motivation are 
mature capacities. 


"No ideally good relation to another human being especially a 
child, is possible without B - love." (7: p.203). 


While in principle self-actualization is easy, it occurs in less 
than 1% of the adult population. (7: p.204). 


Since growth holds not only rewards and pleasures but also intrinsic 
danger, pain and effort, it requires courage, will, choice, and 
strength as well as protection, permission and encouragement from 
the environment. 


An empirical description of the deepest tendencies of the human 
species and of specific individuals implies a naturalistic system 
of values. 


A neurosis is not part of the inner nature of man but a defence 
against it or an evasion of it, as well as a distorted expression 
of it under the aegis of fear. 


‘The state of being without a system of values is psychopathogenic. 


At the level of self-actualizing, many dichotomies became resolved, 
opposites are seen to be unities and the whole dichotomous way of 
thinking is recognized to be immature. 


In healthy people the conative, the cognitive, the affective and 
the motor are less separated from each other and are more synergic. 


Development of a healthy unconscious and of a healthy irrationality 
sharpens our awareness of the limitations of purely abstract 
thinking, of verbal and analytic thinking. 


One of the main conditions of creativity is the ability to dip 
into the unconscious and preconscious, to use and value their 


primary processes and impulses. 
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Esthetic perceiving and creating and esthetic peak-experiences 
are seen to be a central aspect of human life and psychology 
because a) gince peak-experiences age integrative they are moves 
toward health, b) they are life-valu@ting, c) they have value -in 
themselves. 

With increasing maturity health human beings move from neurotic 
pseudo-problems to the real unavoidable existential problems 
inherent in the nature of man (even at his best) living in a 
particular kind of world. 


All humans do not actualize themselves in the same way. 


To the extent that it gratifies all basic human needs and permits 
self-actualization, a culture is growth-fostering. Non-gratifying 
cultures are growth-inhibiting. 


The condition of fullest harmony (merging with a larger whole) 
is full antomony. 


The mature, self-actualizing person lives part of his life in an 

inner, out-of-time and out-of-the-world psychic world and yet is 

able to adapt easily and enjoyably to the real world without con- 
fusing them. 


"Goal-directed, motivated, coping, striving, purposeful action is 
an aspect or by-product of the necessary transactions between a 
psyche and non-psychic world." (7: p.213) 


Growth theory and self-actualization theory hold that not only the 
past exists now in a person but that also the future exists now in 
the form of hopes, ideals, duties, tasks, plans, goals, unrealized 
potentials, mission, fate, destiny, etc. 


II. IMPLICATIONS FOR EDUCATORS 


Ive Objectives 


Maslow appears to see the role of the teacher as that of encouraging 

the free development of the learner toward self-actualization, or 
full-humanness, by providing the best educational conditions for this 
growth process. In the encouragement of such humanness it is necessary 
to consider the need to integrate both the actuality and potentiality 
characteristic of human nature. However, he also lists "insight, 
intellect in the broader sense, creativeness, play and art" (7: p.10) as 
integration techniques--and all of these are common educational goals, 
objectives, or activities. 
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In attempting to reach the desired goal, i.e., an authentic human, 
Maslow warns against over-stressing existential choices or Rogerian 
discovering and uncovering therapy and understressing "the . . . power 
of autonomous social and environmental determinants (ward, poverty, 
social structure) (u: pp.12-13). Maslow infers that to help the 

growth of another human being it is necessary to understand him and 
that the best way to understand him “is to be able to see his world 
through his eyes" (7: p.14). The existential tenet of the ultimate 
aloneness of the individual should remind us of the need to work out 
further such concepts as decision, responsibility, choice, antonomy and 
identity as well as the further problem of communication between alone- 
nesses. Maslow also suggests that -the existentialists can help us 
recognize the limits of verbal, analytic rationality and the need for 
raw experience prior to the introduction of any concepts or abstractions. 


As educators, Maslow contends that we should recognize and accept the 
fact that ''the future is in principle unknown and unknowable, which 
means that all habits, defenses and coping mechanisms are doubtful and 
ambiguous since they are based on past experience. Only the flexibly 
creative person can really manage the future, only the one who can 
face novelty with confidence and without feat" (7: p.16). Therefore 
our basic, underlying objective as teachers should be to produce such 
pe ople. 


B. Encouragement of Growth and Motivation 


Since a learner can only be consistently motivated to learn when he 
feels a desire, or want, or needs, or yearning, or lack, and since 
objectively observable states correlate insufficiantly with subjective 
reports teachers face a major problem in recognizing their student's 
needs. However, if the teacher accepts as fact the tendency of people 
toward growth and self-perfection, then the occurance of growth is 
partly indicated by positive pointing and partly by negative contract. 


The implications for teaching of Maslow's theory of motivation are provoca- 
tive. One down-to-earth implication is that a teacher should do everything 
possible to see that the lower-level needs of students are satisfied so that 
they will be more likely to function at the higher levels. Your students will 
be interested in satisfying the need to understand and know in your classes 

if they are physically comfortable, feel safe and relaxed, have a sense of 
belonging, and experience self-esteem. To help you keep this in mind, here is 
Maslow's list of needs arranged in a literal hierarchial form: 
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Maslow's direct study of a large number of psychologically healthy 
individuals describes the end product of growth and instructs: us with 
respect to the processes necessary for growth. He lists the following 
characteristics of clinically observed psychologically healthy, growing 
people. 


Superior perception of reality. 

Increased acceptance of self, of others and of nature. 

Increased spontaneity. 

Increase in problem-centering. 

Increased detachment and desire for privacy. 

Increased antonomy, and resistance to enculturation. 

Greater freshness of appreciation, and richness of emotional reaction. 
Higher frequency of peak experiences. 

9. Increased identification with the human species. 

10. Changed (the clinician would say, improved) interpersonal relations. 
ll. More democratic character structure. 

12. Greatly increased creativeness. 

13. Certain changes in the value system. 


Comi O UT & WH 


Such healthy people have sufficiently gratified their basic needs - 

but Maslow estimates that this accounts for less than one percent of 
the population. For the remainder, needs are either seen as a threat, 
nuisance, lack or to be enjoyed or accepted. In developing his hier- 
archy of needs, Maslow is attempting to tie together and interrelate 

a person's multiple, separate motivational episodes into a hierarchial 
structure which will account for an individual's growth or regression. 
The different basic needs are related to each other in this hierarchial 
order such that the removal of one need brings about the emergence into 
consciousness of another "higher'' need (7: p.30). This relationship 

of needs is of great significance to teachers in that it implies that 
once a student has satisfied a basic need that need will no longer 
motivate his behavior. It also tells the teacher that self-actualizing 
growth is not possible until basic needs have been gratified. 


It might appear, then, that an affective teaching strategy that provides 
for student's basic needs together with a challenging, supportive 
environment would result in the production of fully human graduates. But 
every teacher knows that even when this is done a student may either not 
grow or regress. Maslow suggests that unsatisfied needs have regressive 
and fixative power, that safety and security are attractive and that the 
unknown is fear inducing. He sees this as a basic existential dilema 

or conflict. Healthy growth ensues "when the delights of growth and 
anxieties of safety are greater than the anxieties of growth and the 
delights of safety" (7: p.47). It is up to the teacher to make sure the 
former circumstances exist and to tell whether the student is ready to 
move ahead on the basis of his choices. "The really good teacher who 
€spouses verbally a completely rosy and optimistic picture of human 
nature, will imply in actual teaching a complete understanding and respect 
for regressive and defensive forces." (7: p.53). 
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CREATING A GOOD CLIMATE FOR LEARNING | RS 


There are four basic conditions for effective learning. Many 
others are important, but the four listed here are essential: 
1. Class atmosphere must be warm, friendly and free from threat. 
Whenever a student feels that he is rejected by you ér by other 
students, or senses that any action or comment of his is met with 
only cold appraisal, his anxiety about himself and how he is getting 
along with others becomes a major concern. When this happens the 
student has little enthusiasm or energy left for dealing with the 
problems of learning. 
2. New ways of acting should be encouraged. While it is important 
that fe classroom provide a warm emotional climate, this should not 
become over-protective. Students should have opportunities for 
experimentation, for venturing into the unknown. This, of course, 
means protection from ridicule in case mistakes are made during the 
process of experimentation. 
3. The student must gradually learn to become independent of the 
teacher's learning supports. It is entirely possible that a student 
will become overly dependent upon his teacher. For example: a 
student of conversational French may chatter away in class because 
he knows it pleases the teacher and wins his praise. Outside of 
class, the same student may seek no opportunities to practice his 
new language skill. He is motivated by a desire to please the teacher 


rather than a real desire to learn French. 


On the other hand, it is possible for an adult student to adopt such 
an extreme attitude of independence toward a teacher or toward other 
classmates or toward school itself that most of his time and energies 


are occupied by psychological withdrawal - and eventual "drop out" - 
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as a way of rejecting the learning experience. The third condition 

therefore, means that for effective learning to take place a 

continuing and Hebden enaunt relationship must exist between the 

teacher and individual Students. 

4. Finally, for effective learning to take place, there must be 

effective, three-way communication - from teacher to student, from 

student to teacher, and from Student to student. 

Conditions for a good instructional situation do not just happen. 
Sometimes a teacher, sincerely desiring a good climate for work, mistakenly 
assumes that it automatically exists. You can, for example, repeatedly tell 
the students, "I am here to help you. Tell me any problems you may have in 
trying to understand our lessons.'"' At the same time, the atmosphere may be too 
cold and forbidding for the student to say honestly and freely, "You talk so 
fast I can't remember what you say." 

A teacher may be personally warm and receptive but lack the skill 
to help the class create unspoken rules of behavior that support free expression 
of opinion. One individual might want to communicate freely with his teacher 
but feels pressure from other members of the class not to respond unless spoken 
EO. 

You'll Need These Skills 

1. The first skill to develop is that of stimulating a clear and 
self-evident sharing of goals. Curriculum demands from outside the classroom 
(such as those of a curriculum committee), the purposes of the teacher, and the 
goals of the students - all these need to be discussed with the students. 
Through group discussion and planning, these many different goals can be built 
into a common goal that becomes a strong and treasured possession of students 


and teacher alike. 
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2. A second skill is that of developing clear "rules of behavior" 
for the group. The group needs to know, for example, under what conditions 
it's permissible to ask a question. . . to make an observation about the way 
something is being done. How are these standards set - by the teacher or by 
the entire class? What is the standard of the group about leadership? Do only 
a few individuals feel free to suggest new activities, ask for help from the 
teacher, suggesting new activities, or does every student have an opportunity 
to try being a leader? What are the rules of behavior about completing a task? 
As answers to these questions are developed, standards of behavior emerge. 
These standards should be developed gradually by you and your students working 
together and talking about the outcome. 

3. The third skill relates to the process of student self-evaluation. 
In order to learn from their own experience adults must constantly evaluate 
their efforts, re-do work when necessary, and rebuild toward shared goals. It 


is your responsibility to provide opportunities for this constant evaluation. 


How to Test Your Learning Conditions 
How do you know whether you have created conditions for effective 


learning? Such conditions exist in your class or group if - 


]. There is unrestricted communication. 

In the early years of cnoe a child carried to the classroom patterns 
of communication he learned at home. He may have been naive and open - or 
withdrawn and unresponsive. However, as he progressed through life, no matter 
how naturally open or communicative he once was, he gradually learned how to 
restrain and control his communication patterns. By the time he has become an 
adult he has learned ways to protect himself from real or imagined attack and 


to display himself to best advantage. 
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Therefore, in some adult classes you may not get questions or comments 
at all when you say, "Are there any questions before I go on and read the rest 
of the instructions on the test?'' You may mistakenly assume that the lack 
of response means your directions have been clear and concise faa that no 
further explanation is necessary. Instead, the lack of response may mean that 
the students are afraid to speak up. As we know from our own reaction if asked, 
when in a large or strange group, if we have any questions, silence may reflect 
embarrassment or confusion rather than understanding. 

On the other hand, if the atmosphere of the classroom reaches the 
level of permissiveness where it is safe for a student to say, "Mr. Smith, 
the illustrations you give are over my head"' or "You said that you were going 
to give the directions only once and I don't think that's right", you have 
suddenly acquired an enormously rich fund of knowledge and insight to help you 
plan and prepare your work. Only as you and your students are successful in 
cetting a picture of yourselves as seen by others can you respond adequately 
i> the teaching ee demands placed upon you. 

2. You are not too "bossy" 

If you are to set up conditions for maximum learning , it is necessary 
to give up some measure of control ‘of the classroom and share this responsibility 
with members of the class. 

To bring this about, you must bring considerable emotional and 
social poise into the classroom. A person who feels the need to control or 
dominate the lives of others may be successful in some endeavors but he is 
ill equipped to help others learn. 


An individual - be it adult student or teacher - who constantly 


needs to defend or protect his own way of working and thinking has little 


opportunity to change and grow. 
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Assignments Are Motivated 


Since many adult courses require students to do outside assignments, 


. 
a 


we should look at the role mec veCion plays here. When teachers simply tell 
students to read a certain number of pages or err oee some other specific 
task, they are not motivating students to do that work. Instead, teachers 
should help students see how the outside assignment will help them achieve 
their own goals. 

Naturally, this approach requires work on your part too. For you 
must help the students think through why they should know the subject and 
how and when they can use it. Only then can the student clearly define the 
desired learning outcomes. The assignment then given to the students should 
include these points: 

1. the lesson objective (what he should be able to do by studying 

the assignment) 

2. to determine why the subject is important to him 

3. where to find the necessary study material 


4. what he will be expected to do or know in the class period 


There's Plenty of Action 
Learning, as we have noted, is an active process and the action must 
focus primarily on the student rather than the teacher. You should, therefore, 
plan a variety of participating activities for the student - observing, 
listening, thinking, remembering, imagining, writing, answering, questioning, 
feeling, touching, moving, agreeing, disagreeing, and discussing. The more 
participation on the part of the student, the more learning will take place. 


Put another way, the more your students use their various senses, the more 


they will learn. 
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Individual Differences Are Recognized 


If the learning process is to be a truly living process, you must 
recognize that individual differences exist ‘among students. No two people 
learn fe the same rate. A student's experience and background in a particular 
subject, for instance, may vary a few weeks or many years from that of another 
student. The teacher who recognizes these differences and plans his teaching 
accordingly will help each student learn as much as he is capable of learning. 
Here are some ways to determine individual differences: 

Student discussion after a presentation by the teacher. - You may 
note that one student absorbed almost all the material, while another student 
digested only isolated bits. The discussion also may help you find out why 
these differences exist. 

Student Records. - If your school has guidance and counselor 
services for adults, they will be your biggest help in detecting differences. 
Their records will show achievement scores and intelligence test scores. 
Educational achievement (in years) sometimes will be helpful, too. 

Private conference. - Through this method you can get to know the 
students as individuals. Learning difficulties and personal problems which 
may be interfering with learning ean be discussed. Information obtained in 
private conferences often can help you adjust course requirements to meet 
students' needs. 

One way of allowing for individual differences in a group is semi- 

ndependent activity which allows a student some time to work alone and permits 
more individual instruction from you. Under this plan, the students meet as a 
group most of the time but for a part of each class or of occasional classes, 


they carry on alone or as parts of small groups. You can help individuals or 
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small groups as the need arises. Students who might hesitate to ask questions 
before the entire group often feel free to ask them privately or in front of 
a small group. Also, since students will interpret information differently, 
questions handled individually can be answered more effectively and will not 


take up the time of the class. 
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ADULT LEARNING - FORM C. 


NAME : 


TIME 1 HOUR 


IRECTIONS : 
Answer all 40 questions. 
. Choose the best answer for each question. 
. Answer on this booklet and also on the machine seared sheet. 
. Keep the booklet and return the machine scored sheet. 


. Record all answers on the machine scored sheet with a soft pencil. 
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Tne single most imp rtant motivating factor for adult learners is: 


a) competition 

b) success in learning 

c) the desire to learn new knowledge 
d) teacher enthusiasm 


Different ways of organizing learning materials have different effects on 
Re adult learner's ability to retain information. Retention is improved 


a) material is presented in small unrelated units 

b) material is organized by the teacher and never organized by the 
learner. 

c) new material is organized to be learned in the way it will be 
needed for use. 

d) the adult learner has complete freedom to organize new material. 


There are several generalizations which can be made with respect to how 
adults learn. The generalizations are sometimes expressed as "laws of 
learning". The following two questions relate to these laws of learning. 


The more often an act is repeated the more quickly a habit is established. 
This statement relates to the law of: 


a) disuse 
b) primacy 
c) effect 
d) exercise 


First impressions are important in learning new material. This 
statement relates to the law of: 


a) intensity 


b) primacy 
c) exercise 
d) effect 


Adults are sometimes ineffective learners at the early stages of a new 
learning experience because of tne problem of being: 


a) limited in intellectual ability 
b) disinterested in the content 

c) afraid of failure 

d) in conflict with other learners 


Maslow sees the role of the teacher as that of encouraging the free 
development of the learner to achieve: 


a) dependence 

b) self-actualization 
c) insight 

d) reliance 
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Learning tasks need to be sequenced. In sequencing learning tasks for 
adult learners it is generally better to sequence instructions: 


a) to coincide with the learner's present knowledge and previous 
experience 

b) according to Maslow's need hierarchy 

c) according to Bloom's taxonomy of cognitive objectives 

d) to coincide with Gagné's "conditions for learning." 


Considering the instructional tasks of managing instruction for adult 
learners; which statement best represents the difference between adult 
and younger (high school) learners. 


a) Adults generally require more guidance than younger learners. 

b) Younger learners generally require more feedback and encouragement 
than adult learners. 

c) In motor skill learning younger learners require more guidance 
than adult learners. 

d) Younger students usually avoid competitive situations (those which 
measure them against others) more than adult students. 


To improve the attentional set of the adult learner the instructor: 


a) should present interesting material even if it is non-essential 
b) often needs to use novel or intense stimuli 

c) should speak slowly 

d) often needs to force the learners to take rests 


The ability of an adult learner to "perceive" new material is directly 
related tc the extent that this new material is: 


a) organized 

b) identified in earlier learning 
c) reviewed 

d) meaningful 


Meaningful material generally is the easiest kind of material for the 
adult to learn and remember. Which kind of learning activity is best 
suited to the establishment of meaningfulness of new material? 


a) partaking in group discussions 

b) working with independent projects 
c) listening to lectures 

d) independently stucying case studies 


Four basic conditions are identified as being essential for creating a 
good climate for effective adult learning. Three of these are: 

1) the teacher's learning supports; 2) classroom atmosphere must be warm, 
friendly, and free from threat; and 3) there must be three-way communication. 
The fourth basic condition is: 


a) feedback should be given to the learner only after he feels secure in 
the new environment. 
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b) The learner must learn to communicate more with the teacher and 
less with fellow classmates. 

c) new ways of acting must be encouraged. 

d) traditional ways of acting must be encouraged. 


The best kind of feedback for adult learners is: 


a) designed to show the individual learners how they are competing 
with the rest of the group. 

b) infrequent so as not to discourage the learner. 

c) never given at the beginning of a learning experience. 

d) frequent and based on individual growth, not competitive status. 


Robert M. Gagne's "Conditions for Learning" outlines a hierarchy of 
seven kinds of learning. Because it is a hierarchy the pre-conditions 
for learning: 


a) must be determined by systematic objective testing 

b) can easily be identified by each learner for himself. 

c) mst be identified and met before moving to a higher level. 

d) must be identified and met after the higher level of learning has 
been achieved. 


R. M. Gagne states that the first kind of learning which must be 
mastered as a pre-requisite to all other levels of learning is: 


a) response learning 

b) identification learning 
c) principle learning 

d) association learning 


According to R. M. Gagné's "Conditions for Learning" the type of learning 
which is acquired when a set of objectives or events differing in 
physical appearance is identified as a class is called: 


a) principle learning 

b) concept learning 

c) response learning 

d) identification learning 


There can be little doubt that there is some decline in the abilities 
of adults to learn as they grow older. Which statement below best 
represents the general nature of this decline in abilities: 


a) There is a regular, highly predictable pattern to the decline of 
learning abilities in adults. 

b) The decline in learning abilities of adults is so small that it 
can be considered irrelevant to the teacher of adults. 

c) The same abilities decline at the same rates in different persons. 

d) The same abilities decline at different rates in different persons. 
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In the development of the human learning capability which ability 
tends to reach its peak latest of all abilities: 


a) reasoning ability 
b) verbal ability 

c) manual ability 

d) remembering ability 


Miller's research pointed out years ago that the average youth's 
(approx. 16 years old) mental facility for remembering (coding of 
material) is limited to a maximum of about seven isolated facts. 
The general mental facility for remembering isolated facts for 
adults (say approx. 40 years and over) is approximately: 


a) avove this "magical number seven". 

b) equal to this "magical number seven". 

c) slightly below this "magical number seven". (i.e. 4-5) 
d) well below this "magical number seven". (i.e. 1-2) 


20. Consider the situation where a person has forgotten some material 


is. 


because he learned it a long time ago and has not reviewed it for a 
long time. This kind of forgetting can be accounted for by the following 
theory of forgetting: 


a) motivated forgetting 

b) passive decay through disuse 
c) retroactive inhibition 

d) proactive inhibition 


Recognition memory involves: 


a) the ability to reconstruct material 

b) reproducing material in complete detail 

c) the short-term memory system in the remembering process 

d) selecting of specific material from a large store of material 


The intellectual ability of adults does diminish over time. The most 
important phenomenon of this decrement in ability that a teacher of 
adults should recognize is: 


a) a decrease in the speed at which adults can learn 

b) decreased interest towards achieving goals 

c) a decrease in the amount of material that the adults can 
ultimately learn 

d) decreased ability to handle verbal material 


Detrimental changes in an adult's ability to learn is most noticeable 
with material which relates to: 


a) problem solving 

b) the development of principles 
c) verbal functions 

d) reasoning by analogy 
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44. Which statement is generally more accurate about adult learners (over 
thirty years old): 


a) 
b) 


c) 


d) 


There is a decline in the adult's ability and speed in learning. 
There is no decline in an adult's ability or power to learn; but 
there is a decline in the speed with which an adult can learn. 
There is a decline in an adult's ability (power) to learn but not 
a decline in the speed at which an adult can learn. 

There is no decline in an adult's ability or power to learn; nor 
in his speed of learning. 


5. To aid in the development of a "memory trace" to ensure retention of 
material in long-term memory, which of the following learning conditions 
should be employed: 


a) 
b) 
c) 


d) 


new material should be put to use as soon as possible 

new material should be repeated many, many times 

new material should not be used in a practical situation until 
it has time to develop into a memory trace 

reinforcement of newly learned material should be postponed for 
at least two or three days. 


&slow's hierarchy of needs forms the foundation of his theory of motivation. 
The following three questions (questions 26, 27, and 28) relate to Maslow's 
hierarchy. 


6. Which one of the following needs is the "highest" on Maslow's hierarchy: 


a) 
b) 
c) 
d) 


esteem needs 

love and belonging needs 
need for self-actualization 
aesthetic needs 


7. Which list of needs (starting at lowest level; going to highest level) 
is most representative of Maslow's hierarchy: 


a) 
b) 
c) 


qd) 


physiological needs; safety needs; love and belonging needs; 


esteem needs 

physiological needs; esteem needs; love and belonging needs; 
safety needs . 

esteem needs; love and belonging needs; safety needs; 


physiological needs 
love and belonging needs; safety needs; physiological needs; 


esteem needs 


1B. The good teacher of adults should assist the learner moving from one 
hierarchial level to another by: 


a) 
b) 
c) 
d) 


administering psychological testing 

using subjective choice (teacher) 

allowing the group to make the choice 

allowing the individual to make his own choice 
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A decline in ones learning ability can be observed to occur starting at 


approximately age twenty-five to thirty years. This can generally be 
attributed to: 


a) physiological changes 

b) changes in one's mental ability 
c) changes in motivation 

d) emotional changes 


One of the most noted changes in an adult's ability to learn is the 
decline in the ability to: 


a) remember vocabulary 

b) remember verbal material 
c) remember isolated facts 
d) remember related facts 


Which one of the following statements best represents the activity most 
useful in helping to retard the deterioration of intellectual processes 
with age: 


a) exercising the mind by memorizing poetry or like tasks 

b) exercising the mind by working with mathematical computations 
c) resting the mind 

d) exercising the mind with creative imaginative tasks 


Generally the best time to learn specific objectives is: 


a) immediately before they are required for use 

b) immediately after learning something very similar in nature 
c) early in the day before one becomes too tired 

d) a significantly long time before the information will be used 


Which of the following statements best describes the differences between 
recognition and recall memory processes: 


a) recognition memory works best for young people; and recall memory 
works best for adults 

b) recognition memory has a greater capacity than does recall memory 

c) recall memory has a greater capacity than does recognition memory 

d) there is generally no difference in the capacity between recall 
memory and recognition memory 


Content which is meaningful to the adult learner is remembered longer. 
Which learning environment would be best suited to the establishment of 
meaningfulness of new material: 


a) listening to a lecture 

b) partaking in self-directed reading 

c) working with computer assisted learning packages 
d) partaking in a group discussion 
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Consider the situation where a person has difficulty remembering new 
material because of confusion with something previously learned. 
This is an example of which one of the following theories of forgetting: 


a) retroactive and proactive inhibition 

b) motivated forgetting 

c) systematic distertions of the memory trace 
d) passive decay through disuse 


Perhaps the best measure of how well something has been remembered is 
to measure: 


a) the rate of forgetting by repetitive testing 

b) the rate at which practice was employed during the original learning 
c) the rate of relearning required to get the original level 

d) the rate at which the original learning took place 


Robert M. Gagné's "Conditions for Learning" has as the highest level on 
the hierarchy the following kind of learning: 


a) problem solving 

b) concept learning 

c) learning of associations 
d) principle learning 


Great care needs to be taken in the selection of content for adult 
education programs. The richest source of content for adults programs 
is attained: 


a) when an expert prepares and teaches the course 

b) when a group of experts select the content 

c) by combining the knowledge of the learners in the class with that 
of the expert 

d) by having the learners select the content 


Which of the following statements is generally more true with respect 
to the difference between adult learners and young learners (high 
school age): 


a) young learners tend to be more rigid in their thinking than adult 


learners 
b) adults are generally less impatient than young learners in the 


pursuit of learning objectives 
c) adults are more insistent on active participation than young people 
d) young people are more insistent on active participation than 

adult learners 


Which of the following statements is generally more true with respect 
to the difference between adult learners and high school age learners: 


a) adults are generally less afraid of failure at the beginning of a 


new learning task than younger learners 
b) young learners are more easily affected by environmental conditions 


(i.e. light, noise, etc.) than adult learners 
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c) 


d) 


adult groups are generally more homogeneous (similar) than young 
groups 


adult groups are generally more heterogeneous (different) than young 
groups 
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ADULT LEARNING - FORM C. 


Answers to: 


Ans. 


estion # 


Ans. 


estion # 


2i 


22 


23 
24 
25 
26 
27 


28 
ey 


30 


10 
ll 


31 


32 


12 
13 
14 
is) 
16 
17 


33 


34 


35 


36 
37 


38 
39 


18 
19 
20 


40 
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ADULT LEARNING - FORM D 


Name: 


TIME: |! HOUR 


rections: 


1. Answer all 40 questions. 


2. Choose the best answer for each question. 


3. Answer on this booklet and also on the machine seared sheet. 


4. Keep the booklet and return the machine scored sheet. 


5. Record all answers on the machine scored sheet with a soft pencil. 
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The single most Important motivating factor for adult learners is: 


a) competition 

b) success in learning 

c) the desire to learn new knowledge 
d) teacher enthusiasm 


Different ways of organizing learning materials have different effects on 
the adult learner's ability to retain Information. Retention is Improved 
(ae 


a) matertal is presented In small unrelated units 

b) material Is organized by the teacher and never organized by the learner 

c) new material is organized to be learned In the way It will be needed 
for use 

d) the adult learner has complete freedom to organize new material 


There are several generalizations which can be made with respect to how 
adults learn. The generalizations are sometimes expressed as "laws of 
learning". The following two questions relate to these laws of learning. 


The more often an act is repeated the more quickly a habit Is established. 
This statement relates to the law of: 


a) disuse 
b) primacy 
c) effect 
d) exercise 


First impressions are Important in learning new material. This statement 
relates to the law of: 


a) intensity 


b) primacy 
c) exercise 
d) effect 


Adults are sometimes Ineffective learners at the early stages of a new 
learning experience because of the problem of being: 


a) limited In Intellectual ability 
b) disinterested in the content 

c) afraid of fallure 

d) in conflict with other learners 


Maslow sees the role of the teacher as that of encouraging the free 
development of the learner to achieve: 


a) dependence 

b) self-actualization 
c¢) Insight 

d) rellance 
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Learning tasks need to be sequenced. in sequencing learning tasks for 
adult learners it is generally better to sequence instructions: 


a) to coincide with the learner's present knowledge and previous experience 
b) according to Maslow's need hierarchy 

c) according to Bloom's taxonomy of cognitive objectives 

d) to coincide with Gagne's "conditions for learning." 


Considering the instructional tasks of managing instruction for adult 


learners; which statement best represents the difference between adult 
and younger (high school) learners: 


a) adults generally require more guidance than younger learners 

b) younger learners generally require more feedback and encouragement 
than adult learners 

c) In motor skill learning younger learners require more guidance than 
adult learners 

d) younger students usually avoid competitive situations (those whIch 
measure them against others) more than adult students 


To Improve the attentional set of the adult learner the instructor: 


a) should present interesting material even if it is non-essential 
b) often needs to use novel or intense stimull 

c) should speak slowly 

d) often needs to force the learners to take rests 


The ability of an adult learner to "perceive" new material Is directly 
related to the extent that this new material is: 


a) organized 

b) identified in earlier learning 
c) reviewed 

d) meaningful 


Meaningful material generally is the easiest kind of material for the adult 
to learn and remember. Which kind of learning activity is best suited to 
the establishment of meaningfulness of new material? 


a) partaking in group discussions 

b) working with Independent projects 
c) listening to lectures 

d) independently studying case studies 


Four basic conditions are identified as being essential for creating a 
good climate for effective adult learning. Three of these are: 1!) the 
teacher's learning supports; 2) classroom atmosphere must be warm, 
friendly, and free from threat; and 3) there must be three-way communication. 


The fourth basic condition Is: 


a) feedback should be given to the learner only after he feels secure in 


the new environment 

b) the learner must learn to communicate more with the teacher and less 
with fellow classmates 

c) new ways of acting must be encouraged 

d) traditional ways of acting must be encouraged 
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The best kind of feedback for adult Jearners is: 


a) designed to show the individual learners how they are i 
compet 
the rest of the group ‘ Pe ht 


b) Infrequent so as not to discourage the learner 
c) never given at the beginning of a learning experience 
d) frequent and based on individual growth, not competitive status 


Robert M. Gagne's "Conditions for Learning" outlines a hierarchy of seven 
kinds of learning. Because it is a hierarchy the pre-conditions for learning: 


a) must be determined by systematic objective testing 

b) can easily be identified by each learner for himself 

c) must be identified and met before moving to a higher level 

d) must be identified and met after the higher level of learning has 
been achieved 


R. M. Gagne states that the first kind of learning which must be mastered 
as a pre-requisite to all other levels of learning is: 


a) response learning 

b) identification learning 
c) principle ltearning 

d) association learning 


According to R. M. Gagné's "Conditions for Learning" the type of learning 
which is acquired when a set of objectives or events differing In physical 
appearance is idcntified as a class Is called: 


a) principle learning 

b) concept learning 

c) response learning 

d) identification |earning 


There can be little doubt that there is some decline In the abilities of 
adults to learn as iney grow older. Which statement below best represents 
the general nature of this decline in abilities: 


a) there is a regular, highly predictable pattern to the decline of 
learning abilities in adults 

b) the decline in learning abilities of adults Is so small that It can 
be considered irrelevant to the teacher of adults 

c) the same abilities decline at the same rates in different persons 

d) the same abilities decline at different rates in different persons 


In the development of the human learning capability which ability tends 
to reach iis peak latest of all! abilities: 


a) reasoning ebility 
b) verbal ability 

c) manual ability 

d) remembering ability 
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Miller's research pointed Out years ago that the average youth's (approx. 
16 years old) mental facility for remembering (coding of material) is 
limited to a maximum of about seven isolated facts. The general mental 


facility for remembering isolated facts for adults (say approx. 40 years 
and over) is approximately: 


a) above this "magical number seven", 

b) equal to this "magical number seven". 

c) slightly below this "magical number seven". (i.e. 4-5) 
d) well below this "magical number seven". (i.e. [-2) 


Consider the situation where a person has forgotten some material because 
he learned it a long time ago and has not reviewed it for a long time. This 
kind of forgetting can be accounted for by the following theory of forgetting: 


a) motivated forgetting 

b) passive decay through disuse 
c) retroactive inhibition 

d) proactive inhibition 


Recognition memory involves: 


a) the ability to reconstruct material 

b) reproducing material in complete detai| 

c) the short-term memory system in the remembering process 

d) selecting of specific material from a large store of material 


The intellectual ability of adults does diminish over time. The most important 


phenomenon of this decrement in ability that a teacher of adults should 
recognize is: - 


a) a decrease in the speed at which adults can learn 

b) decreased interest towards achieving goals 

c) a decrease in the amount of material that the adults can ultimately learn 
d) decreased ability to handle verbal material 


Detrimental changes in an adult's ability to learn is most noticeable with 
material which relates to: 


a) problem solving 

b) the development of principles 
c) verbal functions 

d) reasoning by analogy 


Which statement is generally more accurate about adult learners (over thirty 
years old): 


a) there is a decline in the adult's ability and speed in learning 
b) there is no decline in an adult's ability or power to learn; but there 
is a decline in the speed with which an adult can learn 
¢) there is a decline in an adult's ability (power) to learn but not 
a decline in the speed at which an adult can learn 
d) there is no decline in an adult's ability or power to learn; nor in his 


speed of learning 
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To aid in the development of a "memory trace" to ensure retention of material 
in long-term memory, which of the following learning conditions should be 
employed: 


a) new material should be put to use as soon as possible 

b) new material should be repeated many, many times 

c) new material should not be used in a practical situation until it 
has time to develop into a memory trace 


d) reinforcement of newly learned material should be postponed for at 
least two or three days. 


Maslow's hierarchy of needs forms the foundation of his theory of motivation. 


The following three questions (questions 26, 27 and 28) relate to Maslow's 
hierarchy. 


Which one of the following needs is the "highest" on Maslow's hierarchy: 


a) esteem needs 

b) love and belonging needs 

c) need for sel f-actual ization 
d) aesthetic needs 


Which list of needs (starting at lowest level; going to highest level) is 
most representative of Maslow's hierarchy: 


a) physiological needs; safety needs; love and belonging needs; esteem needs 
b) physiological needs; esteem needs; love and belonging needs; safety needs 
c) esteem needs; love and belonging needs; safety needs; physiological needs 
d) love and belonging needs; safety needs; physiological needs; esteem needs 


The good teacher of adults should assist the learner moving from one 
hterarchial level to another by: 


a) administering psychological testing 

b) using subjective choice (teacher) 

c) allowing the group to make the choice 

d) allowing the individual to make his own choice 


A decline in ones learning ability can be observed to occur starting at 
approximately age twenty-five to thirty years. This can generally be 
attrituted to: 


a) physiological changes 

b) changes in one's mental ability 
c) changes in motivation 

d) emotional changes 


One of the most noted changes in an adult's ability to learn Is the decline 
in the ability to: 


a) remember vocabulary 

b) remember verbal material 
c) remember isolated facts 
d) remember related facts 
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Which one of the following statements best represents the activity most useful 
in helping to retard the deterioration of intellectual processes with age: 


a) exercising the mind by memorizing poetry or like tasks 


b) exercising the mind by working with mathematical computations 
c) resting the mind 


d) exercising the mind with creative imaginative tasks 
Generally the best time to learn specific objectives is: 


a) immediately before they are required for use 

b) immediately after learning something very similar tn nature 
c) early in the day before one becomes too tired 

d) a significantly long time before the information will be used 


Which of the following statements best describes the differences between 
recognition and recall memory processes: 


a) recognition memory works best for young people; and recall memory works 
best for adults 

b) recognition memory has a greater capacity than does recal! memory 

c) recall memory has a greater capacity than does recognition memory 

d) there is generally no difference in the capacity between recall memory 
and recognition memory 


Content which Is meaningful to the adult learner Is remembered longer. 
Which learning environment would be best sulted to the establishment of 
meaningfulness of new material: 


a) listening to a lecture 

b) partaking in self-directed reading 

c) working with computer assisted learning packages 
d) partaking in a group discussion 


Consider the situation where a person has difficulty remembering new 
material because of confusion with something previously learned. 
This is an example of which one of the following theories of forgetting: 


a) retroactive and proactive inhibition 

b) motivated forgetting 

c) systematic distortions of the memory trace 
d) passive decay through disuse 


Perhaps the best measure of how wel| something has been remembered Is to 
measure: 


a) the rate of forgetting by repetitive testing 
b) the rate at which practice was employed during the original learning 


c) the rate of relearning required to get the original level 
d) the rate at which the original learning took place 
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Robert M. Gagne's "Conditions for Learning" has as the highest level on 
the hierarchy the following kind of learning: 


problem solving 

concept learning 
learning of associations 
principle learning 


Great care needs to be taken in the selection of content tor adult 


education programs. The richest source of content for adults programs 
is attained: 


a) 
b) 
C) 


d) 


when an expert prepares and teaches the course 

when a group of experts select the content 

by combining the knowledge of the learners in the class with that 
of the expert 

by having the learners select the content 


Which of the following statements is generally more true with respect 
to the difference between adult learners and young learners (high school 
age): 


a) 


b) 


G) 
d) 


Which of the following statements is generally more true with respect to the 


young learners tend to be more rigid in their thinking than adult 
learners 

adults are generally less impatient than young learners In the 
pursuit of learning objectives 

adults are more insistent on active participation than young people 
young people are more insistent on active participation than adult 
learners 


difference between adult learners and high school age learners: 


a) 


b) 


G) 


d) 


adults are generally less afraid of fallure at the beginning of a new 
learning task than younger learners 

young learners are more easily affected by environmental conditions 
(i.e. light, noise, etc.) than adult learners 

adult groups are generally more homogeneous (similar) than young 
groups 

adult groups are generally more heterogeneous (different) than young 
groups 
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APPENDIX B 


PSYCHOMOTOR LEARNING MODULE 


A) Each learner will be able to identify the essential situations about how 


Module #5 - Principles of Skill Learning 


Curriculum Objectives: 
a TE 


people learn skills. 


B) Each learner will be able to apply the knowledges described in A (above) 


in a) simulated learning environments 
b) actual learning environments 


Activities Code 


rh I 


) aa 


Il 


L2 
R | 
R2 


Instructional Objectives: 


Each learner will identify the "nature of skills" in 
civilized man as demonstrated by being able to: 


a) mame the three essential features of skilled 
performance 


b) develop a model of human performance which: 


1) identifies the stage where perception occurs 
ii) identifies the stage where executive routines 
are developed 
iii) distinguish between "formulation of output 
routines" and "observable performance". 
iv) identifies and distinguishes the difference 
between "intrinsic" and “extrinsic" feedback. 
v) aids in describing at least four possible 
kinds of observable behavior (output) that 
could occur for every instance of input. 


Each learner will develop a taxonomy of psychomotor 
objectives being’ able to list each of the five main 
headings. In addition, each learner will demonstrate 
his/her understanding of the relationships inherent 
in the hierarchial structure of the taxonomy by being 


able to: 


a) demonstrate by describing classroom examples 
typical observable behavior exhibited by a learner 


for each of: 
i) > "early" 


ii) "associative" 
-iii) "autonomous" phases of skill learning 


b) describe how "stimulus generalization" enters into 
the development of skill learning. 
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c) drawa simple raph of the rates of development 
of a skill showing how each of the "phases" tend 
5P2 to exhibit a plateau in learning. 


d) draw Ee graph which helps define the "realistic 
limits” of a skill and accounts for individual 
learning differences. 


III Each learner will demonstrate his/her knowledge of the 


interrelationships between motivation and performance 
by being able to: 


a) define the following: 


i) hypothesis of par 
id). SEress 


¥. 3 iii) alertness 
iv) fatigue 
R3 b) mame three functions of extrinsic feedback 
c) draw a single graph depicting the effect upon 
performance of i) low, ii) high and iii) ambient 


SEFESS 


d) describe at least one learning situation where the 


principles relative to a "vigilance task" are 
5) R 4 observable. 
) m5 e) describe at least one learning situation where the 


principles relative to a "tracking task" are 


} >) 3 observable. 


IV Each learner will be able to identify, describe, and 
discuss the different approaches to the "analysis of 
tasks" of motor skills. The following four approaches 


3] Lis 4. should be analyzed. 


a) component processes and performance capacities 
analysis 


R & b) continuums for skill analysis 
c) factor structure analysis 


d) information-processing analysis 
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V Each learner will be able to describe the essential 


of a skill by being able to: 


Z relationships between speed and accuracy components 
FS o/s 5 


a) 


a7 b) 


e) 


d) 


define "reaction time" 


explain how temporal uncertainty effects simple 
reaction time 


define type "a", "b", and "c'' reaction times and 
describe how they interrelate to explain the 
features of "choice" reaction time 


discuss in a seminar the "speed accuracy trade-off 
phenomena" 


VI Each learner will be able to: 


a) 

/s 6 
b) 
5RB ; 
al F 


R10 
P 4 


select from several choices specific learning 
activities which best facilitate learning for each 
of the three phases of skill learning 


describe two generalizations relative to massed and 
distributed practice in learning a skill 


describe two generalizations relative to whole-part 
practice in learning a skill 


describe several general procedures of instruction 
for the teaching of motor skills. 
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Psychomotor Learning - Form A 


Name: 


Time: 1 Hour 


Directions: 


1. Answer all 45 questions. 


2. Choose the best answer for each question. 


3. All answers are to be recorded on the answer sheet with a soft 


pencil. 


4, Please do not write on this question booklet. 


5. Please return both the question booklet and answer sheet. 


6. Be sure your name is on the answer sheet and on this page of the 


question booklet. 


7. Thank you. 
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Generally for most motor learning tasks, individuals set some standard of 
excellence for themselves and are content to meet but do not strive to 
exceed this standard. This standard is typically: 


a) below the level of performance they are actually capable of 
achieving 


b) above the level of performance they are actually capable of achieving 


c) exactly at the level of performance they are actually capable of 
achieving 


d) changing all the time 


In learning a skill a learner is subjected to some forms of stress 
(ie: demand placed on him by the tasks). Which statement best describes 
how stress effects the learning rate of a learner: 


a) intermittent stress generally is most effective in increasing rates 
of learning 


b) constant high levels of stress generally are most effective in 
increasing rates of learning 


c) intermittent stress usually causes descreased rates of learning as 
compared to constant levels of stress 


d) constant low levels of stress are generally most effective in 
increasing rates of learning. 


Consider the following two types of reaction situations: 


"type 1" a number of stimuli for one of which R is the required 
response - 


"type 2" any one of a number of stimuli with its own response — 


Sl1—>R1_ or S2——>R2 or S3—— PR. 


Which of the following statements would be true with respect to these two 
types of reaction situations: 


a) reaction times cannot be measured and compared for these two types 
of reaction situations 


b) there is no difference in the reaction times for these two types of 
reaction situations 


c) "type 2" would have a longer reaction time than Moyne 


d) "type 1" would have a longer reaction time than “type 2". 
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4, Examine the following graph. 


Performance 


Stress —_ 
Which place on the stress scale (identified by numbers) represents the 
level of stress normally identified as the "ambient level of stress". 


FG) 
bys tac2) 
oy) 
d) (4) 


5. A practical skill situation where "temporal uncertainty" is zero or at 
least very, very close to zero (reaction times also are almost zero) 
is witnessed in the case of which of the following skills: 

a) playing tennis well 

b) operating a lathe well 

c) playing music well 

d) driving an automobile well 

6. Which of the following types of reaction situations would normally exhibit 
the shortest reaction time: 

a) a stimulus with many chained responses - S——>R-—? R—?>R— OR 
b) simple reaction time- S—R 


c) any one of a number of stimuli with each having its own 


response — Sl—> R1 or S2-—3R2 or S3— >R3. 


d) a number of stimuli of which only one has R as the appropriate 
response — 
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If a learner was attempting to master a skill and was rated as performing 


at the "associative phase" of learning, his general observable behavior 
would be something like: 


a) the learning is performing very slow, performs in short steps, and 
makes many errors 


b) the learner appears to be trying to imitate the instructor and also 
makes many errors 


c) the learner is working reasonably fast and is making only a very 
few errors but his performance is interrupted easily by someone 
watching or attempting to talk to him 

d) the learner is working fast and is making only a very few errors and 


is at the same time discussing an upcoming fishing trip with another 
person 


D. W. Manuel's taxonomy of psychomotor objectives would have as the highest 
level (last phase) the following heading: 

a) set 

b) perception 

c) autonomous 

d) associative 

The level or phase in D. W. Manuel's five level taxonomy of psychomotor 
objectives where the learner becomes prepared (establishes a "set'') to 
begin to perform a skill is: 

a) level five 

b) level two 

c) level one 


d) level three 


Instructions given to a learner after he has performed a task should be: 
a) primarily concerned with describing the principles of the task 

b) concerned with giving the learner knowledge of his success or failure 
c) designed to increase stress in the learner 


d) primarily concerned with getting the learner to relax 
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11. An improvement in performance in motor skill behavior may sometimes be observed 
even thoughthe learner has not practiced since the last time his performance 
was measured. This could be accounted for by the fact that: 


a) a rest interval helps improve performance 
b) the learner may have practiced "mentally" 
c) the learner's motivation may have changed 


d) all the above are true 


Examine the model which is presented here. This is a "model of human 
performance" depicting the general makeup of the human processor of 
information and showing where the information is processed. 


Refer to this model for questions 12 to 17 inclusive. 


Answer these questions by identifying the places depicted on the model 
by the numbers 1 through 8. 


PROCESSOR OUTPUT : OUTPUT 
a w ' 


bee a eee Ss a ae 


A Model Of Human Performance 


12. If a learner had hearing or sight disabilities, where on the model of 
human performance could this problem be explained: 


a) vi 
b) 8 
C) th 
d) 4 


13. What area on the model of human performance would help explain learning 
difficulties due to the instructor's cultural background being different 


from that of the learners: 


a) 4 
b) eS) 
c) 6 


d) vA 


waa, 9S Jelmal’ «@ =) aT. & , ‘est 
yo “Geeaw oot pam ols % qu 
. takiote oy mf WORDS ty rede spl este 


-aelavions | mptiy da taesag cot Later arnt. 
Iebom on? 0° Go inte setelg Ode gelq! ee ate} ) peg © 
dquo | @ 


Py —— te oh PAG A cee | 


om =— TT. ell 


ie RE eet re Mic. it 
if 2 9 A. fe ke on Cae 
———— Rae 40+ 2 Fe os : 
) : 
i j y 
ee, ead eee > 


omer me yrel gall’ © fabgr A 


se Led OF 26 ober ent ti den ee Sigil (ro gat tend Patt 
chentviqus al melder@ nigt bison oo 


Pia pt tapibih 


i a vais 


14. 


15. 


16. 


was 


190 


Where on the model of human performance would a person's "poor attitude" 


probably cause inappropriate performance: 


a) 1 
b) 3 
c) 6 
d) 8 


If you had asked a learner to try to perform a certain skill and the 
learner did not make an attempt to do so, one of the reasons could be 
that he did not "perceive" what you were asking him to do. What area 
on the model of human performance should perception have taken place: 


a) 1 
b) 3 
c) 4 
d) 7 


Where on the model of human performance can behavior be observed by 
another person: 


a) 1 
b) 3] 
c) 6 
d) 5 


Where on the model of human performance could feedback be provided to 
the learner by way of video tape playback techniques: 


a) 5 
b) 6 
c) Hi 


d) 8 
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The question often arises as to what extent learners should be forced 
to adopt certain forms (ie: certain posture, grips, etc.) which are 

" 
considered the “best” forms. At what level in learning would it be 


generally accepted that individual learners should be given considerable 
leeway in form adjustments: 


a) early phase 

b) pre-performance phase 

c) associative phase 

d) final or autonomous phase 

When a learner is required to make adjustments to controls in response 
to irregular movements in the stimulus pattern he is engaging in a: 

a) decrement task 

b) ambient task 

c) tracking task 

d) vigilance task 

Loss of alertness occurs more often than fatigue when a person is 
functioning in a work (or learning) situation which is classified as: 
a) an open-ended task 

b) a closed task 

c) a tracking task 

d) a vigilance task 

Skilled performance is classified as such only when the situation (learner 
and task) exhibits the presence of three essential features. Two of these 
features are: 1) the presence of feedback, and 2) the presence of an 
organized sequence of movements. The third essential feature is: 

a) the presence of a certain level of speed 

b) the presence of a certain level of accuracy 


c) the presence of a purpose (being "goal" directed) 


d) the presence of stress. 
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increase in the intensity of stimuli will generally: 


cause simple reaction times to decrease 


cause simple reaction times to increase 


will not cause any change in simple reaction times 


will result in more difficult choices between responses 


Which one of the following statements is generally true with respect 
to the average person who is "mastering" a motor skill (one who has 
achieved a high level of performance): 


a) 
b) 
c) 


d) 


he does not fatigue easily 


he is concentrating on eliminating errors 


he makes many 'extra'’ movements 


he is very conscious of each movement he makes 


Verbal instructions to a learner have the greatest use (amount of effect) 


in helping 
ayervat bite 
b) at one 
cy) cat the 
d) 


the learner develop a motor skill: 
first actual time the learner attempts to perform the skill 
of the pre-performance stages 


stage where the learner has developed a high level of skill 


when the learner requires feedback to help eliminate errors or 
bad habits that have developed 


An instructional method which combines the use of verbal instructions 
and manual guidance will work best: 


a) 
b) 
c) 


d) 


before 


in the 


incorrect habits are formed (early stages of development) 


final phase of skill development 


for correcting bad habits 


is used continuously to the exclusion of other instructional methods 
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Very early in the development of a skill "stimulus generalization" plays 
an important role. Stimulus generalization is depicted in the following 


diagram: 
a) S—>dR 
b) ee 
‘EI eS 
or eR 
S 
d) S—»R——R—>R 


A worker watching an automatic production system in a factory will experience 


long periods of low stress (he will have little to do). This type of 
situation usually results in: 


a) 
b) 
c) 


d) 


increased alertness 
decreased alertness 
increased fatigue 


decreased fatigue 


In general, the most accurate type of sensory input when learning a 
motor skill is: 


a) 


b) 
€) 


d) 


verbal description (someone telling the learner what his performance 
looked like) 


visual inspection (viewing the results of one's own movements) 
manual guidance (someone guiding the learner's hand) 


kinesthetic feedback (paying attention to one's own muscular feelings) 


Which approach to the “analysis of skills" has as the variables to measure 
a list similar to: rate of movement, numerical facility, psychomotor 
speed, perceptual speed, visualization, and others: 


a) 
b) 
i) 


d) 


information - processing analysis 
continuums analysis 
factor structure analysis 


component process analysis 
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One way to analyze skills is on the basis of various continuums. One 
such continuum has at the one end the suggestion that some skills are 
continuous (ie: riding a bicycle). The opposite end of this continuum 
would best be represented by the term: 

a) discrete 

b) coherent 


c) non-coherent 


d) broken 


Every skill can be analyzed with respect to the load piaced upon various 
component functions. There are four component functions: 1) sensory, 
2) perceptual, 3) memory, and 4) responses. Which of these four 
component functions relates to: - pattern recognition, selective 
attention, and rate of search for stimuli: 

a) sensory 

b) perceptual 

c) memory 


d) response 


Motivation and knowledge are provided to a learner through extrinsic 


(external to the individual) feedback. A third generally accepted 


function of extrinsic feedback is to provide: 
a) a source of stimuli 

b) a source of rewards 

c) stress 


d) reinforcement 


Consider the following statement. 


"A learner has been practicing a skill for some time and is at the 
stage where he is beginning to gain more speed after a period of 
practice which resulted in relatively little increase in speed." 


Considering the work of R. M. Gagné, which one of the following diagrams 
best depicts the category of learning (S = stimulus; R = response), 
operative at this time: 
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In practicing vocational skills it is probably better to practice according 
to the method known as the: 


a) whole method 
b) part method 
c) whole - part - whole method 


d) part - whole - part method 


Reaction times generally increase as a result of: 

a) increased practice 

b) increased intensity of the stimulus 

c) decreased temporal uncertainty of a stimulus 

d) increased temporal uncertainty of a stimulus 

Humans have certain limitations when it comes to performing skills. These 
limitations can be classified into five main categories. These categories 
are the ability to: 1) discriminate, 2) recognize, 3) time, 

4) remember, and 5) generalize. The following three questions refer to 
these limitations. 

You observed that a learner had more difficulty than other students in 
learning a new skill shortly after learning a previous similar skill. 

This is an example of which category of limitation: 

a) time 

b) discriminate 


c) generalize 


d) remember 


Which limitation involves the ability to detect differences: 
a) remember 

b) discriminate 

c) recognize 


d) generalize 
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Which limitation is closely related to one's ability to handle spatial 
problems: 


a) time 
b) remember 
c) generalize 


d) recognize 


Relative to transfer in training between motor skills involving similar 
patterns, which statement best represents the instructional procedures 
that should be employed: 

a) these two skills should be taught at the same time 

b) these two skills should not be taught at the same time 

c) identical methods should be employed 

d) the instructor should use examples from the first skill learned to 


demonstrate how the second skill should be learned 


Robert M. Gagné outlined eight categories of learning in his famous 

work "Conditions for Learning." Which of the following of Gagné's categories 
could be classified as a psychomotor category: 

a) principal learning 

b) signal learning 

c) chaining 

d) problem solving 

Many skills are easily measured by measuring the amount of information 
processed by the learner over a specific amount of time (ie: measurement 


of typing speed/accuracy). The highest speed/accuracy relationship is 
attained when the error rate of information processed is about: 
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Which of the following graphs would best represent the increase in 


performance from the early Stage of learning a skill to the final stages 
of learning a skill: 
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In practicing a motor skill, an early emphasis on developing speed is 
important if: 
a) ‘the nature of the skill is continuous 
by) the nature of the skili is discrete 
@)) acectiracy is a vital part of the task 


d) speed is a vital part of the task 
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44. If the performance of a group of learners is plotted on a graph with the 


scale for # of trials expressed on a log scale, the following graph 
(below) is developed? 


Performance 


10° THY abo” 10% 10% 108 
; ETT ge 
Which of the following statements best expresses the significance of this 


graph relative to the amount of practice required to attain a certain 
specified level of skill: 


a) very little increase in performance relative to amount of practice 
is attained at the beginning of practicing a new skill 


b) very little increase in performance relative to amount of practice 
is attained at the end (or when approaching maximum skill level) of 
practicing a skill 


c) the amount of change in performance is directly proportional to the 
amount of practice for all stages of skill development 


d) the amount of change in performance is inversely proportional to the 
amount of practice for all stages of skill development 


45. In comparing the following two teaching methods, which would be the most 
accurate statement relative to the effectiveness of these methods in 
helping learners develop motor skills. 


The two methods are: 


Method (1) verbal instruction plus practice 
Method (2) trial-and-error practice only 


a) these methods would perform differently for different kinds of 
skidis or, for different kinds of learners 


b) there is no difference in the effectiveness of these methods 
c) method (1) is better than method (2) 


d) method (2) is better than method (1) 
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Psychomotor Learning - Form B 


Name: 


Time: 1 Hour 


Directions: 


1. Answer all 45 questions. 


2. Choose the best answer for each question. 


3. All answers are to be recorded on the answer sheet with a soft 


pencil. 
4. Please do not write on this question booklet. 
5. Please return both the question booklet and answer sheet. 


6. Be sure your name ts on the answer sheet and on this page of the 


question booklet. 


i.e hank vou. 


200 


Learners tend to adopt individual forms and styles (posture, grip, etc.) 


when developing a motor skill. Instruction on "standardized" forms and 
Styles: 


a) should never be given 

b) should be given only at the late stages in learning 

c) should be given only at the earlier stages in learning 

d) should be given at all stages in learning 

Probably the best time to give an adult learner verbal instructions 
(feedback) is when he is practicing a motor skill is: 

a) when he finds it necessary to ask for it 

b) at the very beginning of the practice session 

c) at the very end of the practice session 

d) all the time (throughout the entire practice session) 

The fact that many musicians can play music together and keep "perfect 
time'' is attributed to the fact that: 

a) they have practiced together 

b) they were born with special ability to measure time 

c) they have very short simple reaction time abilities 

d) temporal uncertainty in music is zero 

When a learner is required to sort out certain stimuli from a large 
number being received in succession, and is to respond to only certain 
(a very few) of these stimuli he.is engaging in: 

a) a tracking task 

b) a vigilance task 

c) an ambient task 


d) a decrement task 
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If speed is a vital part of a skill, which of the following statements is 
most true: 


a) accuracy should be developed first then place an emphasis on speed 
development 


b) emphasis on developing speed should be at an early stage in learning 
c) emphasis on developing speed should be at the final stage of learning 
d) no emphasis should be placed on developing speed 

The level or phase in D. W. Manuel's five level taxonomy of psychomotor 
objectives where the learner first actually attempts to perform a skill is: 
a) level five 

b) level two 

c) level one 

d) level three 

D. W. Manuel's taxonomy of psychomotor objectives would have as the lowest 
level (first phase) the following heading: 

a) set 

b) perception 

c) autonomous 

d) associative 

The "hypothesis of par" is the label for the phenomena where for most 
learning tasks, individuals set for themselves some standard of excellence. 
Which statement is most true relative to this standard of excellence: 

a) learners typically perform below this standard 

b) learners typically never try to achieve this standard 

c) learners typically perform above this standard 


d) learners typically perform above this standard if encouraged to do so 
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Feedback should help a learner improve with practice. Which form of 
feedback is most useful in the majority of skill learning activities: 


a) verbal feedback (somecne telling the learner what his performance looked like 
b) visual feedback (viewing the results of one's own movements) 
c) kinesthetic feedback (paying attention to one's own muscular feelings) 


d) tactile feedback (feeling how the performance is by touching) 


Which approach to the "analysis of skills" has as the variables to 
measure, a list similar to: concept of purpose, scanning, identification 
of relevant cues, interpretation of cues, etc.: 

a) information-processing analysis 

b) component processes analysis 


c) factor structure analysis 


d) continuums analysis 


Robert M. Gagné outlined eight categories of learning in his famous work 
Conditions for Learning. The second and third categories [stimulus 
response learning (operant conditioning) and chaining (motor response 
sequences) can be viewed as psychomotor categories. At what level in 
skill development as described below would "chaining" play a significant 
role: 


a) the learner is preparing to try a skill for the first time 
b) the learner has just tried a skill for the first time 


c) the learner has been practicing a skill for some time and is at this 
stage attempting to eliminate errors 


d) the learner has achieved a high level of skill after much practice 


Which of the following graphs best represents the relationship between r 
performance and the three generalized levels of stress; "low", "ambient", 
and “high: 


a) be 
Qe 
‘i 3 
ov pu 
Low Ambient High Low Ambient High 
Stress ————> Stress ———»> 
c) d) 
i 
: 
Low Ambient High en zg 


Stress z Stress ————> 


a] 
(ytdcuds WW ad soneaea hve ints 2 


es sobdnitey ods on at “ti se ait Yad 
1 IP 1me5% 
ik oe en ae a 


Whatsann aninosne 


uta any “asedeaoTe Jasae | 
gid bees srus 00738 ee i. 
etov firs wncoley te 7 


tr 

dosw wteiea V aka 48 gtA aaah) Se bp Prego tue Sage bat fi ae Sag ripe : 
-4/ aes) eaPoaweter hagas bem hnocks olf petoxest ‘wood (Line 

a>aihey, 100") “ at) bee Coriep (4ibeag thavege) anlieias) eenegees 

v2 Joust, Yate’ SA gh ha? Yos- vials veges toweivy ad Bay 7 


lone ingle a enta” po ikea wivew eiled gadétpeed ea. enange oh Edel 
‘es ans Se 


omey gach? hdd 2. LPde © pe a Aad tagerq af (Temeeek ane ee 
eata soe Git 0) Ge as bake) taut ace viiuel shee” 


gasle ac @) BD Geo) woe te Titan me Eee aew qosd al ponteal, O48 
niet ellaltia of a toqmerre eats 


agtiseseg A yea tate Lf ioe, te Tevet nytt © hive fitss ned wreak itt j 


pga rs Ae i et wh) étesaprqee Dene eagese te pis’ 
‘“snergan”  \odewta Tr alawel ree aa sotlY wet 


WD. 


14. 


JES 


LG. 


203 


Skilled performance is classified as such only when the situation exhibits 
the presence of three essential features. Two of these features are: 
1) the presence of an organized sequence of movements and, 2) the presence 
of a purpose (or being "goal directed). The third essential feature is: 
a) the presence of feedback 
b) the presence of a reasonable amount of accuracy 
c) the presence of a reasonable amount of speed 
d) the presence of stress 
Instructions given to a learner at the Stage where he is getting ready 
to perform a task should be: 
a) acquired through intrinsic feedback 
b) acquired through extrinsic feedback 
c) primarily concerned with describing the principles of the task 
d) primarily concerned with describing how to develop speed in the task 
o 
"Chaining", one of R. M. Gagne's categories of learning which can also 


be called a psychomotor category, is depicted best in which one of the 
following diagrams: 


a) S b) S——»S——»S— »R 
or SPR 
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Which of the following graphs would best represent the relationship 
between "amount of practice" and "amount of increase in performance" 
usually observed of groups of learners developing a skill: 
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Skills can be analyzed on the basis of various kinds of continuunms. 


such continuum deals with the skill constancies. This continuum is 
presented here: 


Body Body Body Body 
at rest in motion at rest in motion 
Object Object Object Object 
stable stable mov ing in motion 
, 62) p) pO 
Golf drive Basketball Batting Running 
foul shot a ball pass 
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One 


Which place on the continuum (represented by numbers from 1 to 4) represents 


where skills are more complex and hardest to analyze: 


a) (1) 
De 2) 
ay NG?) 
d) (4) 


Fatigue occurs more often than loss of alertness when a person is 
functioning in a work (or learning) situation which is classified as: 


a) an open-ended task 
b) a closed task 
c) a tracking task 


d) a vigilance task 


An Air Traffic Controller's job involves paying attention to, and res 
to many, many stimuli for relatively long periods of time. This type 
of situation usually results in: 

a) increased alertness 

b) decreased alertness 


c) increased fatigue 


d) decreased fatigue 
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Which of the following types of reaction situations would normally exhibit 
the longest reaction time: 


a) simple reaction time - 1.$S——31.R 


b) a number of stimuli for one of which R is the required 
response - 


NnNnNnNnN 
t 
w 


c) any one of a number of stimuli with its own response - S1——>Rl or 


S22 RZ. Or 53 eR. 


d) a stimulus with two chained responses - S——»>R——R 


Below is a model of human performance. This model depicts the general 
makeup of the human performer and helps identify where various "problems" 
can arise when a person is attempting to perform a skill. Refer to this 
model when answering questions 21 to 26 inclusive. Answer these questions 
by identifying the areas depicted on the model by the numbers 1 through 8. 
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A Model of Human Performance 


At what area on the model of human performance would stimuli from the 
environment occur: 


a) 8 
b) 4 
c) 3 
d) i 


Sometimes a person can "feel" when he has completed a physical task well 
(ie: a good golf swing). What place on the model of human performance 
associates with this phenomena: 


a) 2 
b) 6 
c) i, 


d) 8 
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If you concluded that a learner did not have the mental capacity to 
understand how to perform complex physical behaviors (complex skills) 
at what point on the model would this deficiency be depicted: 


a) 4 
oD 
) 6 
d) i 


Suppose you had given a demonstration on how to perform a certain operation 
on a certain piece of equipment. Further suppose that one learner could 
not see the demonstration because he was too far away. Where on the 

model of performance could this problem be shown and subsequently help to 
explain the learner's inability to learn the task: 


a) 2 
b) 1 
@) 4 
d) 3 


Where on the model of human performance would a learner's physical inability 
(lack of size, strength, etc.) effect the nature of his physical behavior: 


a) 5 
b) 6 
c) 5 
d) 2 


If you concluded that a learner had difficulty in completing a physical 
task well because he had received too much to learn in too short of 
time, then to what part of the human model of performance would you 
associate this problem: 


a) 4 
b) 5 
c) 6 
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Reaction times generally decrease: 


a) 
b) 
e) 


d) 


with an increase in the intensity of the stimuli 


with a decrease in the intensity of the stimuli 


when the intensity of stimuli goes below the threshold 


after long periods of no practice 


If a learner was attempting to master a skill and was rated as performing 
at the "autonomous phase" of learning, his general observable behavior 
would be something like: 


a) 


b) 


2) 


d) 


the learner is performing very slow, performs in short steps, and 
makes many errors 


the learner is only preparing his work station before starting 
to work 


the learner is working reasonably fast and is making only a very 
few errors but his performance is interrupted easily by someone 
watching or attempting to talk to him 


the learner is working fast and is making only a very few errors 
and is at the same time discussing an upcoming fishing trip with 
another person 


Motor skills can be improved by engaging in mental practice (mental 


rehearsal for instance). The above statement: 

a) applies only to very simple skills 

b) applies best when learning is taking place at the advanced level 
c) applies best when learning is in its early stages 

d) is not true. 


Which one of the following statements is generally true with respect to 
the average person who is beginning to learn a new motor skill: 


a) 
b) 
c) 


d) 


he does not fatigue easily 
he makes "extra'’ movements 
he does not learn from imitation 


he is generally motivated more to learn than the person who is 
Vnastering™ a skill 
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One's ability to perform a skill well is inhibited by certain limi- 
tations. These limitations in one's ability can be categorized into 
tive groups. These are the ability to: 1) discriminate, 2) recognize, 
3) time, 4) remember, and 5) generalize. The following three questions, 
(31, 32, and 33)make reference to these five main limitations. 


The ability to handle spatial problems is most closely related to the 
a Dusit yetor 


a) remember 

b) discriminate 

c) recognize 

d) time- 

Which limitation involves the ability to place information (or stimuli) 
imto a Correct category ; 

a) recognize 

b) remember 

c) generalize 

d) time 

Which limitation would effect a learner's ability to use the skills 
learned in one skill to help learn a different skill: 

a) remember 

b) discriminate 

c) recognize 

d) generalize 

Four component functions are recognized as one basis for the analysis 
of skills. These component functions are: 1) sensory, 2) perceptual, 
3) memory, and 4) responses. Which of these four component functions 
relate to: - variety, accuracy, timing, repetition, and refractory period: 
a) sensory 

b) perceptual 

c) memory 


d) responses 


asvipunk aotaes, 


(tfuibie. wo) eofieeyvtnt) oom G2 Yel ttde at 
| 7 sytoge28o" : 


, mak 
lida aft ope ao @etlede weed @ reb)is, bl vow aotsestal) 
22%0 cee 116 @ reel her oF Mirage sun at} 

. ae 6 ove 


pay e 
ae or s] 


ey tals ofp ae) efeg! Ane ag bre 

faa (& wovess oi 

oli en seeronins 5 soods 
inhgoq we Jaee ey Sree 


2) s 


56. 


Ds. 


209 


Examine the following graph which depicts the development of skill 
showing how each of the "phases" tend to exhibit a plateau in the 
rate of learning: 


@ 


Perf. 


@ 
® 


Itials =. 


Which place on the graph (identified by numbers) represents where the 
learning has reached the "associative" phase: 


a) il 
b) Z 
c) 5 
d) 4 


Stimulus generalization plays a significant role in the development of 

a skill. It is generally defined as the substitution of new stimuli for 
an old stimuli which has the ability to cause the same conditioned 
response to occur. At what phase (or phases) in the development of a 
skill would stimulus generalization come into play: 

a) early or "cognitive" phase 

b) intermediate or "associative phase" 

c) final or "autonomous" phase 

dye DOthe by aid <c)) 

Extrinsic feedback (feedback which is external to the learner) is generally 
thought to serve three basic functions in learning a skill. Two of these 
are: 1) to provide knowledge, and 2) to provide reinforcement. The third 
generally accepted function of extrinsic feedback is to provide: 

a) tension 

b) stress 


eye stimuls 


d) motivation 
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Consider these two instructional methods: 
- Method (1) - demonstration plus practice, 


- Method (2) - trial-and-error practice only. 


Which of the following statements would be most accurate relative to 
the efficiency of these two methods in teaching motor skills: 


a) method (1) is better than method (2) 
b) method (2) is better than method (1) 


c) these methods would work differently for different kinds of skills 
or for different learners 


d) these methods would work equally well in most instances 

Manual guidance of gross skills is thought to be most useful in molding 
movements into the desired forms: 

a) when instructing adults 

b) in the final phase of skill development 

c) before incorrect habits are formed (early stages of development) 


d) when instructing young learners 


Increased temporal uncertainty of a stimulus will: 

a) result in easier choices between responses 

b) cause reaction times to decrease 

c) cause reaction times to increase 

d) wiil not affect a change in reaction times 

Which statement below best describes how stress effects learning rates 
im Learning a skill: 

a) constant high stress is best for maximum learning rates 

b) constant low stress is best for maximum learning rates 


c) intermittent or fluctuating levels of stress are best for maximum 
learning rates 


d) stress has no effect upon learning rates 
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Negative transfer of training can occur when the two skills being learned: 
a) have the same perceptual components 


b) have different patterns 


c) are taught at quite different times and by different methods 


d) have similar patterns 


Generally as one attempts to increase the speed of skill, errors begin 
to happen. This speed/accuracy trade-off phenomena is evident in 

many areas of skill development. Generally the highest speed/accuracy 
relationship which can be achieved is achieved when the number of errors 


amounts to approximately 4% of the total amount of information 
processed: 

a) 0.5 

by 2.0 

e)meeLO.0 

d) 0 


Consider the following two types of reaction situations: 


Type (1) any one of a number of stimuli with each having its own 
Eesponse — Si1-——sRi,- S2——*RZ,, 53-93: 


Type (2) simple reaction time - S——>R 


Which of the following statements would be true with respect to these two 
types of reaction situations: 


a) type (2) would have a longer reaction time than type (1) 
b) type (1) would have a longer reaction time than type (2) 
c) these two types of reaction times cannot be measured and compared 


d) there is essentially no difference in the reaction times for these 
two types of reaction situations. 
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Practicing a skill can involve long continuous periods of practice 
(massed practice) or it can be accomplished by short periods of practice 


with intervals of rest between (distributed practice). 


If the intervals of rest in a distributed practice situation are 
approximately equal to the length of the practice sessions then which 


of the following statements is most true: 


a) better performance would be attained if the rest intervals 
longer 


b) better performance would be attained if the rest intervals 
shorter 


c) there would not likely be any difference in performance if 
rest intervals were longer or shorter 


d) better performance would be attained if the rest intervals 
very close to one-half as long as the practice sessions. 


were 


were 


the 


were 


poate nd bai 
meena tet a 
«86 © » ortsnay tebe abss 
datae mt —T ukiuayg whe TM 
ion 9 


biiew sinernat yer aha M hawt BY: 


7 


grab b)® 
ore 


oj a 
iP 


baal 
Om 


evew abihvimeom Jon) els u bi : ; aa 2 
- Y ve 
of? 2F snéwro iiay 9! poets se he a st abana 

14d tae) Yo ogee 8 10 otovreial ae ie 7 


a 
osew' al uvvesea) geit he % techatte on pete erga i te 
eooinees. . 2IbATg EET Oa: pro! os ial os Sao y 
: " 


a _ 


2M3 


APPENDIX C 


CURRICULUM BIBLIOGRAPHY 


214 
CURRICULUM BIBLIOGRAPHY 


Ammons, Margaret. ‘Objectives and Outcomes," pp. 908-914 in Robert L. Ebel 


(ed.), Encyclopedia of Educational Research, Fourth Edition. 


New York: Macmillan, 1969, 


Baker, R.L. Curriculum Evaluation; Review of Educational Research. 1969, 
39, pp. 339-358. PS Re gg 5 eae Se eel 


Bebell, C.F. The Educational Program: Part One; In Emerging Designs For 
Education. E. L. Morphet & D. L. Jesser (Eds.), New York: 
Citation Press, 1968, pp. 1-56. 


Bellack, A.A. "History of Curriculum Thought and Practice"; Review of 
Educational Research. 1969, pp. 283-292. 


Berman, L.M. New Priorities in the Curriculum. Columbus, Ohio: Charles E. 
Merrill, 1968. 


Blanke, Virgil, E. (Ed.). "Planning for Educational Change"; Theory Into 
Practice. Vol. V, No. 1, February, 1966. 


Bobinger & Weaver. Trade Analysis and Course Organization. 1968. 


Broudy, Harry S. "The Philosophical Foundations of Educational Objectives," 
Educational Theory, 20 (Winter, 1970), 3-21. 


Bruner, Jerome. ''The Skill of Relevance or the Relevance of Skills." Saturday 
Review, 53 (April 18, 1970), pp. 66-68. 78-79. 


Carr, William G. (Ed.). Values and the Curriculum: A Report of the Fourth 


International Curriculum Conference. 19/70. 


Clark, David L. and Egon G. Buga. "An Examination of Potential Change Roles 
in Education," pp. 110-113 in Center for the Study of Instruction, 


Rational Planning in Curriculum and Instruction. Washington, D.C.: 


National Education Association, 1967. 


Cunningham, Luvern L. "Effecting Organization Change"; Organization - A Means 
for Improved Instruction. L.W. Downey, et al. (Eds.), 1962 Leader- 
ship Course for School Principals, pp. 104-129. 


Downey, L.W. "Goals of Education for the Future"; Encyclopedia of Education. 


Sy ar 

Easley, J.A. Jr. "Curriculum Development, Teacher Education and Educational 
Research." Paper given at Allerton House, 1967. 

Easley, J.A. Jr. "The Natural Sciences and Educational Research - A Comparison," 


High School Journal, 50 (October, 1966), pp. 39-50. 


"Formulating Instructional Objectives," and "Stating Objectives," pp. 300-303 
in John D. McNeil, "Forces Influencing Curriculum," Review of Educational 


Research, 39 (June, 1969), pp. 293-318. 


4, sap toa "ankoaain ue Ect 
/¢ wette®)  -abny , ionigithee ee ea 


yal veeidy | owned) Ltunbhebebt gay patio tba) i s ea 
agtt PUaS as: Oe _f oh . otov ae; 


2305 .podtextoummy gatony: See Bhoglens Ree || pes 


\ soutdeel dO’ tadotsanub’ te G@nortahnwet Lsolidewstidt 2 it wee 
ic-e ew inl) St oa ues a - 


yobvaeee "sal 1795: 8 ia eal 4 ofa ge jodie tid és ifif2 adt™” e868 “tea 
“ae “Hh, Did cole y OTEE 8! Leeqh) £6 (eee 


esti ti, Pe AN Sane 2 mes 
a guts) Leqotseneeser 


ick seal) (eapaet te sereeehbaal MD iat 5 229g8 toe .2 bbestt | 
woes cuttaal te stoge hs 14 hay “ap aie 9 is ine) er | 


*, 2.0 5 ated Bind! 


ee i jMagumit? ata 
aust = ae axer Ie 2m, erent « 
pC f-#32-<.ee \* 


ChaeguN Be albaqeioeaiet petri: seth wat Pereney 7 lnc? 


' vietvaqded 4 davperel, Lecgijsees. rd 
<duBt sgl (dedi y 


roe WE 94 i ei nat? 


mien 


215 
Foshay, Arthur W. Curriculum for the 70's: An Agenda for Invention. 
1970. 


Gagné, Robert M. "Learning Hierarchies," Educational Psychologist, 
6 November, 1969, pp. 3-6. , 


Gallagher, James J. "The Changing Face of Educational Research and 
Development.'’ Paper given at A.E.R.A., Minneapolis, 1970. 


Joyce, Bruce R. and Berj Harootunian. The Structure of Teaching. Chicago: 
Science Research Associates, 1967. 


Kibler, Robert J., Larry L. Barker, David T. Miles. Behavioral Objectives 
and Instruction. Boston: Allyn and Bacon, 1970. 


Light, Richard J. and Paul V. Smith. "Choosing a Future: Strategies for 
Designing and Evaluating New Programs,'' Harvard Educational Review, 
40 (February, 1970), pp. 1-28. 


Macdonald, James B. "Educational Models for Instruction - Introduction," 
pp. 1-7 in James B. Macdonald and Robert R. Leeper (eds.), Theories 
of Instruction. Washington, D.C.: Association for Supervision and 


Curriculum Development, 1965. 


Maguire, Thomas 0. ''Decisions and Curriculum Objectives," Alberta Journal 
of Educational Research, 15 (1969), pp. 17-30. 


Payne, Arlene. The Study of Curriculum Plans. Washington, D.C.: National 


Education Association, 1969. 


Popham, W. James. "Curriculum Materials," Review of Educational Research, 
39) (June, 1969). pp. 319-3338. 


Popham, W. James, et al. Instructional Objectives, AERA Monograph Series 
on Curriculum Evaluation, 3. Chicago: Rand, McNally, 1969. 


Popham, W. James and Eva L. Baker. Planning and Instructional Sequence. 
Englewood Cliffs, New Jersey. Prentice-Hall, 1970. 


Pyatte, Jeff A. "Functions of Program Evaluation and Evaluation Models in 
Education" High School Journal, 53 (April, 1970), pp. 385-700. 


Short, Edmund C. "Curriculum Scholarship: Sources of Knowledge for the 
Curriculum Field," pp. 7-19 in Edmund C. Short (ed.), A Search 
for Valid Content for Curriculum Courses. 


Stake, Robert E. "Generalizability of Findings" and "Rationalism and 


Empiricism," William H. Beatty (ed.), Improving Educational 
Assessment and An Inventory of Measures of Affective Behavior. 


Washington, D.C.: Association for Supervision and Curriculum 
Development, 1969. 


5 


. | : 
apul pots Sevpayanyt <.e3LiM .7 BE 
te! , angel bow aye €. Byocat: Wo Ldowess 


ant atigetexs® * Ssautut a banka ras Pee ey 


walvpk 10058 Saonbst bo oval taaviaes ins pgylasd 
"er te wes 44 HKONEL: pranuatig’) BM = 


" getsowwbevjel - aol otter) 14s Bercy Seaonsenubs" 18 esa - £4 bs 

eoiveogt ,{,ubs) teqeal Fi s7ad468 ban sy ahr! 8 gemet ai A-t 
cna sorelwraqué wg salielconeh: +21.0 sGRprEleeW  .bobsop ei ene: 
aed athena heres & 


o eel’ + aif)’ (a4 oe 7303 fen sootek gett! 6a 
CL pg OGRE) CEO iene se Tynar? a 


a eee 


seniset: *..09 weenie ets : eva ko yime « a 
o> Laetitia ee, st 


i peend Leumgzengehd “6 225 eat " ateboaset wnites! >a" «3208: 
,e>-er a , (eaer ees 


bent. i wT eae ‘AGHA #2 ¥2 elt. Me ead ak Ph) met ae 
eeet hie bane Soy fauievt ad Larabar 


#708 Tre Loubbaqazags bs & gnincets Tg oft O82 tna ita 
“E) [tall =a) saats eA SOL QWItlhd booralgeet 


at ateboM tal sec. 099 (84) 06f)400,/ 0% e707), Be eeslaaie fa 
COTS yg . (OTS phbves) 12 feet Ss 


ait 30% aba id’ Gamat iqinaspled oe eos 
hoxeet a tebe) sw 29 Srowh pt.e 1 yng 
couroy) dv inse3 30% 2; 
dna at Lagutasa ah baa ie we 
er oes. ie 
oh vetad aves 
xele a 


auiws: THE 


216 


Stake, Robert E. "Objectives, Priorities and Other Judgment Data.'' Review 
of Educational Research, 40 (April, 1970), Dp. ibl=Zi7; 


Stake, Robert E. and Terry Denny. ''Needed Concepts and Techniques for 
Utilizing More Fully the Potential of Evaluation," pp. 370-390 in 
Ralph W. Tyler (ed.), Educational Evaluation: New Roles and 
New Means. NSSE 68th Yearbook, Part II, 1969. 


Telfer, Richard G. "Dynamics of Change: Focus Behind Curriculum Modification," 
Clearning House, 41 (November, 1966), pp. 131-135. 


Tyler, Ralph W. Basic Principles of Curriculum and Instruction. Chicago: 
University of Chicago Press, 1969, pp. 479-481. 


Tyler, Ralph W, et al. Perspectives on Curriculum Evaluation. AERA Monograph 
Series on Curriculum Evaluation, 1. Chicago: Rand McNally, 1967. 


Walberg, Herbert J. "A Model for Research on Instruction," School Review, 
78 (February, 1970), pp. 185-200. 


Westbury, Ian. "Curriculum Evaluation." Review of Educational Research. 
40 (April, 1970), pp. 239-260. 


What Are the Sources of the Curriculum? Washington, D.C.: Association for 
Supervision and Curriculum Development, 1962. 


Wittenlock, Merle and David Wiley. The Evaluation of Instruction. New York: 
Holt, Rinehart, and Winston, 1970. 


Worth, Walter, H. Report of the Commission on Educational Planning. Edmonton, 


Queen's Printer, 1972. 


Zidonis, Frank J. "Effecting Curriculum Change Through Research." Theory 
Into Practice, 6 (April, 1967), pp. 85-88. 


_ 


ogi i aos 21h etek tak ya Q “fie: Nik net 


ad saa re bra 
“2 0g r= OTE ae" oisa rs 
vs 43.0 eet Dian are 


an = enc! se 7304 
al 


Seb. (638 


_ 


a r 
iggast> §6apieha quia READ woh (i) tu eelghoa’ 14 
z t3 . aq ae _ ae da 


A ATA 4) ‘mi Saws ai 4 =f Ts xu ehy 48 “ sist 7 
Toe. .~LLeRt tara =fGogresey. vi fe oi welyvolt 


wotyed Levdpe Ce pws ae ‘oe nih 442 isbuMt 
7. ee | ,OUT- 20) 009 . Ee 4 


‘avoliouwlst to welvet ” doe iol xtochey ot a 
a tl Tee SMES a3 (Cotee .TEagAD, OF 


L BD » 
7) - 
3 gvat £.9.0 Srodgenrivey) teat pissud ody. $0 west pa ess Be 


=) oom 


® 'y , a¥ joa ~e J t ira See ait. a en eh 


A ed Pane hiv bo sa 
Pome the stun, 9 


‘ , nal 6 i a ; 
9 a8 ; ; . “to @& re Shey fad a To ef tr oa > 
Ss — oad - = _— a _— a 
Po a niyt ofa 
, sneer’ ayunmil asad? mua 


—— 


4 


So 


fi-?h .¢a@ of ORI 


: ee 
- 

: Pa by 55 
- 


7 
7 


ZL 


APPENDIX D 


DATA COLLECTION INSTRUMENTS 


- we 

fas ls ATER, 2 is 
sik a fe - 

True dole 309 ata 


218 


General Biographical Information 


Name: (please print) 


Age: (check one) under 20 vears |__| 
20-24 years [| 

25-29 years [| 

30-34 years [ | 

35-39 years [|__| 

40-44 years | } 

45-49 years |} 

50 vears % overf | 


Formal Education: (ie. high school, colleae, university, etc.) 
high school completed yes | no{_ | 
number of years beyond hich school (approx.) less than 7 year [_ | 
1 year (__} 
2 years [| 
3 years [| 
4 years ff] 
Sor over{_ | 


Briefly describe type(s) of formal education received beyond 
highschool. 
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Work 


Experience: 


Exp: 
Exp: 
Exp: 
Exp: 


Exp: 


Exp: 
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Please list types of work experience you have had to 
date including teaching experience. Please list these 
in a cronoloaical order and estimate the amount of time 
(in years to the nearest 1/2 year) that you contributed 
to each experience. 

Time: 

Time: 

Time: 

Time: 

Time: 

Time: 


a ne 


Time: 


Time: 


ee on ET = 


Time: 


Time: 


EXD opens eee ee ee fe ee —_—_—_—___—— 


Name: 


TEACHING ADULTS 


What do you consider to be the single most important 
feature about the nature of adult students to be 
considered when teaching a class of adults? 
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QUESTIONNAIRE - TEACHING ADULTS 


When teaching a class of adults which of the following features about 
fhe nature of adult students do you consider to be most important? 


irections: For each pair of statements below mark with a tick ( ow the 
feature you consider most important. Remember: 


A. The question printed above is the question you are 
trying to answer for each nair of features. 


B. Please place one tick ( wa) for each pair of features. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


The adult student is generally impatient in the pursuit of learning 
objectives. 


. The adult student usually requires a longer time to perform learning 
tasks. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


. The adult student is likely to be rigid in his attitudes and beliefs. 


The adult student is generally impatient in the pursuit of learning 
objectives. 


Adults are sometimes fatigued when they attend classes. 


The adult student is likely to be rigid in his attitudes and heliefs. 


. Adults are easily distracted by inappropriate (noisey, etc.) 
learning environments. 


The adult student usually requires a longer time to perform learning 
tasks. 


. Adults are sometimes fatigued when they attend classes. 


Adults are easily distracted by inappropriate (noisey, etc.) 
learning environments. 
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The adult Student is generally impatient in the pursuit of learning 
objectives. 


The adult student 
tasks. 


usually requires a longer time to perform learning 


Wesaehe student tends to have difficulty in remembering isolated 
acts. 


The adult student is generally impatient in the pursuit of learning 
objectives. 


The adult student is likely to be rigid in his attitudes and beliefs. 


Healt student usually requires a longer time to perform learning 
tasks. 


Adults are easily distracted by inappropriate (noisey, etc.) 
learning environments. 


The adult student tends to have difficulty in remembering isolated 
facts. 


The adult student tends to have difficulty in remembering isolated 
facts. 


The adult student usually requires a longer time to perform learning 


tasks. 


Adults are easily distracted by inappropriate (noisey, etc.) learning 
environments. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


The adult student tends to have difficulty in remembering isolated 
facts. 
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Adults are easily distracted by inappropriate (noisey, etc.) 
learning environments. 


The adult student is likely to be rigid in his attitudes and beliefs. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


Adults are sometimes fatigued when they attend classes. 


The adult student is generally impatient in the pursuit of learning 
objectives. 


Adults are easily distracted by inappropriate (noisey, etc.) 
learning environments. 


The adult student tends to have difficulty in remembering isolated 
facts. 


Adults are sometimes fatigued when they attend classes. 


The adult student tends to be afraid of failure at the beginning of 
a new learning task. 


The adult student is likely to be rigid in his attitudes and beliefs. 


Adults are sometimes fatigued when they attend classes. 


The adult student usually requires a longer time to perform learning 
tasks. 


The adult student tends to have difficulty in remembering isolated 
facts. 


The adult student is likely to be rigid in his attitudes and beliefs. 


Adults are sometimes fatigued when they attend classes. 


The adult student is generally impatient in the pursuit of learning 
objectives. 
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Name: 


Record of "Out of Class" Activities 
for 


ADULT LEARNING MODULE 


vate Topic Type of Activity Time Spent Remarks 
a 


——————— aan Laat ican) —— 
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Name: 


Record of “Out of Clase" Activities 


for 


PSYCHOMOTOR LEARNING MODULE 


vate Topic Type of Activity Time Spent Remarks 
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SKILL LEARNING - A RATING SCALE 


Below are six statements relative to the learning of skills. Read 


each statement carefully and then check (./) one of the columns 
opposite each statement. : 


Strongly Disagree 
Strongly Agree 


1. People who have trouble in academic" programs 
usually do very well in "vocational" programs. 


2. Motor skills can be learned very quickly. 


3. Compared to "cognitive" learning environments, 
the learning environment for the development 
of motor skills is better suited to 
individual learning. 


4. Trial and error techniques should be an 
integral part of the learning activities 
in skill development programs. 


5. Motor skills are harder to learn than cognitive 
skills. 


6. Lack of motivation is not a problem generally 
associated with the learning of motor skills. 


’ _ 
Pa pe 
: 17 7 
aa io bidw 


onahes win ty : 


\ 7 r = | 
rot oe 
| ; |? 
; i ie 
Gar 4 
EL eey | 
oh ek a a. 
aren Sees fs - S a — 
. | a pclae ps a atsveors py se 
' : pete ? ‘Wpo" "at £f ihc 
; ‘J “ai prec roa “ aa — 
as -— ot — + eat 
| alleg 8 oor hee 
j +! 
» . o> +« ore Lede endian porn Tt? — ie 
| |, ste, ‘ gations ant uw tatnges™ 
. ‘ —uieinté Gb oss ted tn ROS = 
| . 63 bowls aeroa sed nt ry 
1a ‘ - egadarsand, 
| ; ’ + . py 
ar ean ae: Ge it : Pee . 
ne od bio pieninivad wvTS we Lary 
; eaahetsee.j wedi 7 cor 7 om *h2 4 
| | . ‘ ° et end aon eh ye ot aur 
—" —_ 
; y 
| 
i u 
af ; = 


2 oe 


ei amg anideng 
al! as to208 3 13 as 
7 


Name: 


ADULT LEARNING - A RATING SCALE 


Below are seven statements about adult students. Read each statement 


carefully and then check one of th h 
gta tenant. (Vv) e columns opposite eac 


) 

« 
My 
2 
A 

The adult student is likely to be rigid in his 

attitudes and beliefs. | 

The adult student is generally impatient in | 

the pursuit of learning objectives. 

The adult student tends to have difficulty Pace ees 

in remembering isolated facts. 

The adult student usually requires a longer S 20k 

time to perform learning tasks. 

The adult student tends to be afraid of | | 

failure at the beginning of a new learning | 

task. | | | 

Adults are sometimes fatigued when they Parks 

attend classes. 7 | 

Adults are easily distracted by inappropriate ele ae 

(noisey, etc.) learning environments. _ 
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APPENDIX E 


JUDGMENT MEETING HANDOUTS 
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EVALUATION THEORIES AND MODELS 


An extenSive search of the literature has been made to select 


an evaluation model suitable for the purposes of this research. 


Only a mention of the major models reviewed is made here. These 


include: 


1. The Expected Opportunity Loss (E.L.0.) Model - Tanner (1970) 


2. Transactional Model for Curriculum Evaluation - Parsons § 
Tenenberg (1970) 


3. Uffelman's Model for Analyzing & Comparing Instructional 
Strategies and Programs - Uffelman (1970) 


4. The CEMREL Evaluation Model - Pohland (1970) 
5. The CIPP Model - Stufflebeam (1971) 
6. A Theoretical Evaluation Model - Taylor & Maguire (1972) 


7. Evaluation by Stages - Provus (1972) 


Stake's Model 


Briefly stated, Stake's Model was selected because it is more 


applicable than others because of the developmental tasks involved 


in the study where many unique inputs are anticipated. 


Stake's Model, 


an eclectic model, best ensures that the right questions are asked 


and all the questions are asked. Mackay and Maguire (1971) aptly 


demonstrate this point. 


Poacunmary it ss USerul tO highlight three kinds of 
models of evaluation. Each reflects the background 
and concerns of its authors. Neo-Tylerian models 
such as Walbesser's focus on the learning process 
and the sequences of objectives necessary for 
achievement. The role of evaluation is primarily 
formative. The eclectic models, like Stake's focus 
on the collection of data both to answer and to 


raise questions. Administrative models, like 
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Stufflebeam's are closely tied to the collection of 
anfOrmation for particular decisions. 


Stake (1967) stresses the importance of collecting data from a wide 
range of sources. He points out that data are divided into two 
dimensions: one dimension separates the data into descriptions and 
judgements; and the other dimension classifies data into antecedent, 
transaction and outcome. Determining the degree of relationship 
and agreement among the various calsses of data amount to the total 
evaluation necessary. Figure 1 depicts the layout of Stake's Model. 
It is helpful for clarification of the model to distinguish 
between antecedent, tuansaction and outcome data. An antecedent, 
according to Stake (1967) is any condition existing prior to 
teaching and learning. Transactions are the countless encounters 
between teachers and students, students and students, students and 
other personnel and other sources of knowledge or other interfaces 
with an opportunity to react. The boundaries between what is ante- 
cedent data, and what is transaction data are not always totally 
clear. Outcomes are the data synonomous with achieved abilities, 
attitudes, knowledges, skills and the like of clients resulting 
from the educational experience. At the planning stage of an 
educational program (INTENTS) the boundaries and relationships 
between antecedents, transactions and outcomes must be specified. 
Ideally there is a logical contingency between the three kinds 
of data. The specification of the intents for the three kinds of 
data would follow a pattern similar to: 1) expecting these ante- 


cedents, 2) and expecting these kinds of transactions, 5) these 


outcomes should be attained. However, they are not necessarily 


specified in the timeline sequence suggested by this description. 
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Examination within the descriptive matrix of Stake's Model helps 
clarify this relationship. This clarification can only come about by 
examining the processing activities that are played out in the des- 
criptive matrix, which is represented in Figure 2. 

Stake points out that there are two principal ways of processing 
descriptive data. These are to determine the contingencies among the 
antecedents, transactions and outcomes; and to find the congruence 
between intents and observations. Contingencies are of two types, 
logical and empirical; the first type referring to the relationships 
that should exist, and the latter type referring to the relationships 
that are observed to exist. The establishment of logical contingen- 
cies 1S a question of expert judgement and is ideally determined at 
the planning phase of all educational programs. Empirical contingen- 
cies are based on observations and are usually statistical problems 
of estimating the relationships among variables. 

To have a high measure of congruence between the cells of the 
intended columns and the cells of the observed columns, the intended 
antecedents, transactions and outcomes would have to come to pass. 
Mackay and Maguire (1971) make significant statements in regards to 
congruency by stressing two.major points. "Firstly, it may be that 
incongruence is desirable in the long run, especially, if the intents 
can be shown to be invalid for some reason. Secondly, congruence does 
not assure validity, only fidelity" (p.31). 

In describing the function of the judgement matrix, Stake (1967) 
states that there are two bases for judging the characteristics of a 
program, ''l) with respect to absolute standards as reflected by 
personal judgements and 2) with respect to relative standards as 


reflected by characteristics of alternate programs" (p.532). 
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Figure 2. A representation of the processing of descriptive data. 
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Standards upon which to base the jugements will likewise have to come 
from either absolute sources (expert selection) or relative sources 
(other programs or norms). In the same article (1967, p-553)' Stake 
elaborates on the processes of making judgements. 


Before making a judgement the evaluator determines 
whether or not each standard is met. Unavailable 
standards must be estimated. The judging act it- 
self is deciding which set of standards to heed. 
More precisely, judging is assigning weight, an 
importance, to each set of standards. Rational 
judgement in educational evaluation is a decision 
as to how to pay attention to the standards of 
each reference group (point of view) in deciding 
whether or not to take some administrative action. 
Relative comparison is accomplished in similar 
fashion except that the standards are taken from 
descriptions of other programs. It is hardly a 
judgemental matter to determine whether one pro- 
gram betters another with regard to a single char- 
acteristic, but there are many characteristics and 

the characteristics are 
not equally important. The evaluator selects 
which characteristics to attend to and which 
reference programs to compare to. 

From relative judgement of a program, as well 
as from absolute judgement we can obtain an over- 
all or composite rating of merit (perhaps with 
certain qualifying statements), a rating to be 
used in making an educational decision. From 
this final act of judgement a recommendation can 
be composed. 


Figure 3 represents the processes of judging the merit of an educa- 
tional program, and it can be readily seen that data from all six 


cells of the descriptive matrix must come into play in the decision 


making. 
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A representation of the process of judging the 


Figure 3. 
result of an educational program. 
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The kationale. Results of data collection and summarization 
relative to the "Rationale" of the Stake Model is a direct outcome 
of the directed interview with Mr. Les Morgan (Director of Research 
and Staff Development at N.A.1.T.). The results are summarized and 
presented in paragraph form with identification of the kinds of 
questions asked and also with additional information offered during 
the interview. 


The major reasonwhy an in-service program is being 
established at N.A.I.T. is that for the most part 
hiring of instructional staff employs selection crit- 
eria which are heavily weighted towards "technical 
content'' expertise. It is subsequently felt that 
there is a need for each instructor to be able to 
perform effectively as a teacher. 

The major goals of the total in-service program 
are to provide skills, knowledge, and an opportunity 
to develop a competency to perform effectively in 
the classroom or laboratory. To meet this general 
goal pedagogical content (i.e. learning psychology, 
teaching strategies, curriculum development skills, 
etc.) constitutes the core of the program. 

This in-service program will serve all in- 
structional staff. Any instructor who has docu- 
mented evidence that he or she possesses good 
pedagogical competencies can participate in the 
program on a voluntary basis. As can be seen by 
the format of the program, part is generally compulsory 
for all instructional staff. 

The general format of the program is to have two 
general categories of in-service offerings. Category A 
would normally be compulsory and be directed at all new 
instructional staff. Category B would be voluntary and 
directed at all instructional staff. Category A will 
have a decentralized component (handled by the indivi- 
dual teaching departments) and a centralized component 
(handled by the overall] administration of the Institu- 
tion). 9 the decentralized component includes orienta- 
tion to the individual teaching departments with an 
opportunity to identify specific immediate needs prior 
to instructing, and attempting to meet these specific 
needs. The centralized component will constitute 
seven working days of general orientation to policies 
and procedures of the total Institution and its man- 
date to clients and industry. This component also in- 
cludes instruction in safety procedures and first aid 


procedures. 


eS 


7 aan “ aa : 
wi he . it PY 


an ae re 


horede tah Yo baal 


bre bes Pte ern 


te alyede a? tio pace: bh 
ue berth iv ape 


6 


‘ i : 4 , ae av79) 
‘ee ’ 7 : 
ead ez ‘ S3gotq meet +. Say 
wa yoom 943 tat fait at dase 
jive vebroalaz & 


Latoea" ehce 03 $31 r A daidw”# 7 


city 2492 xismeapeal 
ft atte we 08 ser “i noraet 
4 : -vettuaa3 

stgutg moinaee-at te 47 4 :* gi = aT 
' re Vale an bee ,sqbet mint +41 = 4 02 et) 
viavisyetts wiottag 03.144 mraeqeas mf avers 
2 \b t M722 


ie 
ay 
i 


Th 
tarasneq ety tesy et. calet x 


‘a 
. eaz gvinzesi 9. z) Peeaned 
hide 3 meg Law + sabe 298g 535" 22 
rugery s/0 9SParer sft dare aneo fe 
~ok Clo wees Lite wryory siyrae-ak aid 
ob ea Gffw t9parevent yah Vsre i 
; foeroenug oe ‘2 od tants, om 
ed? wa evmylohsneq rab 20 Laura 2oquou 

wd gpase ou. eo aA : iged “787 vlov 

\ Vite <8 | ¢lisrer ah a tide . ame yu" adr 
7 Pigs bgt by nt (fn 


aan ion os 


pty ~ @RTo:% bp Tera 


» aoe aver aa ei mar yote $F ‘Yo whereot 

L wieguds) .2gcike otto votvr9: no = 

a its ¥a. & rrotéh ed’ one aa 
Hie Os ne blaow 8 oral ore a¢ 

j ae | qn 15RD tat of wes 27. +: 7 . 


it oO? “0 be ae ‘ay os =a 


ae 3 4 sf 
cat wir Yo Mod textes eo 
° a3 nat 7 Wh DITE #98 ee bs 


, 4 ,< gaodtr teoal 


ve tate AEE ae 
antoifoe oF quazey sie A dabeae 14 
ca ont tuw agdouakgach yy Oat Be 


“ai cela Jageog iat ee oa LT. 
Bhar "hat eaioa > : 
-, 


a 


=. 
—s t 
= 


Category B of the total in-service program at 
N.A.I1.T. has three components. One component provides 
recognition via a special diploma for instructors who 
have developed, taught, taken, or challenged courses 
of technical content within N.A.I1.T. A second compon- 
ent provides recognition and encouragement for comple- 
tion of courses, seminars, etc. offered at other 
institutions or in industry. The third component, 
more identifiable as a truly "in-service" program, is 
a comprehensive program of general and specific 
pedagogical content. (Researcher's note: This compon- 
ent of the total in-service program at N.A.I.T. is the 
component within which the sample of modules of 
curricula were presented and studied.) The content 
for this component will be offered as credit-hour 
modules. A module is functionally defined as being 
independent of any pre-requisite relationship with 
other units of curricula (other modules). 
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Module #1 Adult Learninr 


a. Each learner will be able to identify the essential characteristics of 
adult learners and be able to use this knowledge to help design and 
conduct good adult education programs. 


Activities Code 


Instructional Objectives 


I Each learner will comprehend the essential charac- 
teristics of adult learners by being able to: 


a) 
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d) 


e) 


identify several generalizations about adult 
intelligence. 


identify the features of two major kinds of 
memory processes and how they typically operate 
within the adult learners; and be able to 
hypothesis as to which one(s) of the four 
theories of forgetting play a significant role 
in the forgetting patterns of typical adult 
learners. 


examine various hierarchies of learning sequences 
and specifically relate R. M. Gagné's 

“Conditions for Learning" to the immediate 
problems of curriculi being taught at the 

present time. 


discuss and criticize the general theories of 
motivation; and be able to relate Maslow's 
hierarchy of basic needs to the needs of typical 
adult learners. 


List, discuss, and defend several generalizations 
about the psychological characteristics of adult 
students you have worked with during the past 
year; and relative to these generalizations, be 
able to hypothesis some possible implications 

for designing and conducting adult education 
programs. 


II Each learner will comprehend and apply the essential 
considerations relative to designing instruction 
1 L/S 3- for adult education programs by being able to: 


1R8 5 


identify the sources of valid content for adult 
education courses. 
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b) select and help others select appropriate 
learning tasks. 


c) select and plan for a variety of valid 
instructional processes. 


d) prepare appropriate instructional objectives 
for adult learning programs. 


III Each learner will comprehend and apply the essential 
considerations relative to managing instruction for 
adult education programs by being able to: 


a) establish procedures and guidelines for 
appropriate guidance of adult learners. 


b) establish procedures and guidelines for 
appropriate feedback to adult learners. 


c) establish and maintain a learning environment 
suited to the characteristics and needs of 
adult learners. 
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Module #5 - Principles of Skill Learning 


Curriculum Objectives: 


A) Each learner will be able to identify the essential 
people learn skills. al situations about how 


B) Each learner will be able to apply the knowledges described in A (above) 
in a) simulated learning environments 
b) actual learning environments 


Activities Code Instructional Objectives: 
I Each learner will identify the "nature of skills" in 
civilized man as demonstrated by being able to: 


a) name the three essential features of skilled 
performance 


SLi 


b) develop a model of human performance which: 


i) identifies the stage where perception occurs 
1i) identifies the stage where executive routines 
are developed 
fii) distinguish between "formulation of output 
routines" and "observable performance". 
iv) identifies and distinguishes the difference 
between "intrinsic" and "extrinsic" feedback. 
v) aids in describing at least four possible 
kinds of observable behavior (output) that 
could occur for every instance of input. 
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Il Each learner will develop a taxonomy of psychomotor 
objectives being able to list each of the five main 
headings. In addition, each learner will demonstrate 
his/her understanding of the relationships inherent 


in the hierarchial structure of the taxonomy by being 
able to: 


bi? 


a) demonstrate by describing classroom examples 
typical observable behavior exhibited by a learner 


for each of: 
f) s“early- 


ii) "associative" 
441) "autonomous" 


b) describe how "stimulus generalization" enters into 
the development of skill learning. 


phases of skill learning 
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cy) 


d) 


crue a Simple graph of tne rates of development 
of a skill Showing how each of the "phases" tend 
to exhibit a plateau in learning. 


draw a simple graph which helps define the "realistic 


limits" of a skill and accounts for individual 
learning differences. 


Each learner will demonstrate his/her knowledge of the 
interrelationships between motivation and performance 
by being able to: 


a) 


cy) 


d) 


define the following: 


i) hypothesis of par 
ii) stress 
iii) alertness 
iv) fatigue 


mame three functions of extrinsic feedback 


draw a single graph depicting the effect upon 
performance of i) low, ii) high and iii) ambient 
stress 


describe at least one learning situation where the 
principles relative to a "vigilance task" are 
observable. 


describe at least one learning situation where the 
principles relative to a "tracking task" are 
observable. 


Each learner will be able to identify, describe, and 
discuss the different approaches to the "analysis of 
tasks" of motor skills. The following four approaches 


should be analyzed. 


a) 


b) 
c) 


d) 


component processes and performance capacities 
analysis 


continuums for skill analysis 
factor structure analysis 


information-processing analysis 
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V Each learner will be able to aescribe the essential 
relationships between speed and accuracy components 
of a skill by being able to: 


a) define "reaction time" 


b) explain how temporal uncertainty effects simple 
reaction time 


c) define type "a", "b", and "c" reaction times and 
describe how they interrelate to explain the 
features of "choice" reaction time 


d) discuss in a seminar the "speed accuracy trade-off 
phenomena" 


VI Each learner will be able to: 


a) select from several choices specific learning 
activities which best facilitate learning for each 
of the three phases of skill learning 


b) describe two generalizations relative to massed and 
distributed practice in learning a skill 


c) describe two generalizations relative to whole-part 
practice in learning a skill 


d) describe several general procedures of instruction 
for the teaching of motor skills. 
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ANTECEDENTS (Clients) 


INTENDED OBSERVED 
M.W. gro 
fper module 25 ay “y : pies ais: 
Age: 
range 25 - 55 25 - 60 27 - 61 
mean 35 Boar 41.4 
Completed H.S.: 
yes 75% V1é 682% 
no 25% 23% 32% 
Education Beyond H.S.: 
less than 1 year 302 182 48% 
between 1 year and a degree 452 32% 28% 
degree completed 25% 50% 242 
Pedagogical Instruction: 
none 702% 79% 762% 
some 25% 162 122% 
certified 5% 5% 122 
Experience: (Teaching) Adult % Other % Adult % Other %{| Adult % Other 
none 0 80 0 79 0 83 
less than 1 year 0 0 0 0 0 0 
2 years 30 0 | Sz 0 29 0 
3 - 5 years 40 10 36 0 44 4 
5 or more 30 10 32 21 27 a Os 


Work Experience (Mean) 5 years 7.3 years 8.8 years 
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ANTECED ENTS (Resource “Person ) 


The resource person (teacher) is identified to instruct for 
both modules was the researcher. Those qualifications pertinent to 
the tasks of instruction in the two modules, in the context of adult 
in-service instructor education are: 

Age - 34 years 
Education - B.Ed. in Industrial Arts 

M.Ed. in Industrial Education 

Ph.D. candidate in Educational Psychology 
Teaching Experience - Two years in Jr.-Sr. High School 


Eight years teaching in Faculty 
of Education 


Planning and conducting several 
in-service programs, work- 
shops, etc. in Adult context 
over past five years 

Rapport - Previous good rapport with similar clientele 
The physical facilities identified for use with both modules 
constituted that facility which normally was available for group in- 
service activities at N.A.I.T. Generally this facility included: 
A standard adult classroom for 25 to 30 people 


Good audio-visual support 


Good environmental conditions 
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PsvctometoR  hEARNING MODULE 


INTENDED AND OBSERVED TRANSACTIONS 
CIN CLASS AcCTiviTIES) 


INTENDED e———_ 


OBSERVED 
MW GRouP e- —- —- is 
TR GROUP ®------------- : 


Inf- Int. Deta Col. Feed ba k 


Abutt LEARNING mopDutE 


AT-HOME ACTWITIES 
CMEAN TIME IN MIN) 
IWTENDED ———————~ 


300 
OBSERVED 

250] mW > 
Tikal ae Ss se 


Time CM/y.) 


“TOTAL 


Speci¢ted  Un-Speci tied Studying 
Reading peony € : 


Review 


PSYC HOMmoToR LEARMIWEe ModULE 


AT-HOME ACTWITIES ¢ 
CMEAN TIME IN MIN) 
IWTENDED ——~- 
OBSERVED 
MW os > 


Time CM/¥.) 
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INTENDED AND OBSERVED TRANSACTIONS 


Adult Learning Module 


a) 


b) 


In-Class Activities 


Listening and Observing 
Group Discussion 
Practicum Activity 
Informal Interaction 
Data Collection 


Formal Feedback 


At-Home Activities 


Reading Specified Material 


Reading Unspecified Material 


Review and Studying 


INTENDED 


502% 
162 
8.5% 
8.5% 
8.5% 


8.5% 


Mean 
240 min. 
60 min. 


60 min. 
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OBSERVED 


M.W. Group |T.R. Group 


56% 
8% 
62 
8% 

122 


10% 


Mean 


105 min. 


13 min. 


37 min. 


612% 
7% 
5% 
8% 

10% 


9% 


Mean 
180 min. 
46 min. 
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INTENDED AND OBSERVED TRANSACTIONS 


Psychomotor Learning Module 


a) 


b) 


In-Class Activities 


Listening and Observing 
Group Discussion 
Practicum Activity 
Informal Interaction 
Data Collection 


Formal Feedback 


At-Home Activities 


Reading Specified Material 


Reading Unspecified Material 


Review and Studying 


INTENDED 


504% 
16% 
8.5% 
8.52 
8.5% 


O.0% 


Mean 


240 min. 


60 min. 


60 min. 
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OBSERVED 
M.W. Group | T.R. Group 

59% 56% 

5% 6% 

10% 112 

82 8% 

82 82% 

102% Tales 

Mean Mean 
138 min. 172 min. 
42 min. 56 min. 
65 min. 83 min. 
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OUTCOMES (COGNITIVE OBJECTIVES) 


Adult Learning Module 


Pre-test Post-test 
M. W. Group eLith Gs ar £5 OF 
eR. Group 22.64 20.05 
Probabilities for Diff. Between Means 
M. W. Group 0.027 
Tt. ke Group 0.041 

Psychomotor Learning Module 

Pre-test Post-test 
M. W. Group 19.45 20e00 
Tks, GLOoup Tonos 26.41 
Probabilities for Diff. Between Means 
M. W. Group 0.016 


T. R. Group 0.019 


‘ysl —ay% 


Chet 


a 2 | 


OUTCOMES (AFFECTIVE OBJECTIVE) 


(7 STATEMENT LIKERT SCALE - ADULT LEARNING) 


Statements: 1 Zz 3 4 5 6 


M-W Pre-test Saunt Lil St 4.053 3.947 4.105 5.568 Z2,0a2 


M.W.Post-test yee yes) Peo 52947 3.842 4.368 Sn Oo 5.421 


TR oPLe-test Soe Zia 5S. 706 5.535.167 5.025 Ie SOO, Ae el oe 


T-R Post-test SeOZs S<2U8> 45125 Soro Diode, 3.417 3,417 


CORRELATION BETWEEN FOUR SETS OF SCALE VALUES 


M-W Pre M-W Post T-R Pre T-R Post 


M-W Pre 
M-W Post 1.000 0.835 0.746 


T-R Pre 1.000 Oa at Ui 


T=R Post 
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OUTCOMES (AFFECTIVE OBJECTIVES) 


(6 STATEMENT LIKERT SCALE - PSYCHOMOTOR LEARNING) 


Statements: it 2 3 4 5 6 


M-W Pre-test o.055 Paes) e he: SFkete ls) 3.947 2.947 3.000 


M-W Post-test 2.007 2.500 4.060 3.667 2 Old Seeze 


T-R Pre-test Fag} o\) OA ibs Ve SeGho Zeal OZ 22020 SoC 


T-R Post-test 2.440 PER PA) 3.920 3.880 2.560 3.240 


CORRELATION BETWEEN FOUR SETS OF SCALE VALUES 


M-W Pre M-W Post T-R Pre T-R Post 


M-W Pre 1.000 0.900 02657, Of 909 
M-W Post 1.000 0.851 0.980 
T-R Pre 1.000 OawiZ 


T-R Post 
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ADULT LEARNING MODULE 


Descriptive Matrix: 


Question #1. 


In your opinion was there an adequate logical contingency? 


Rate: (check one) Low eee] Med. [3 High [| 


Please elaborate: 


Question #2. 


In your opinion was there sufficient congruency? 


Rate: 


(check one) Antecedents Low fess Med. [ | High [| 
(check one) Transactions Low = Med. aes High | 
{check one) Outcomes Low ee Med. [| High ina 


Please elaborate: 


Question #3. 
In your opinion was there an adequate empirical contingency? 


Rate: (check one) Low feel Med. eae High a 


ree TPT 


bg) 
1 tan 
ei 
ed 


= la 8% 


ADULT LEARNING MODULE 


Judgment Matrix 
Standards: 


Group concensus as to which of three possible sources of standards 
to select must be attained. The source of standards agreed upon by all 
judges is checked below: 


a - Pilot Project 
a - Intended Column 


fe - Those specified on following sheet (developed by this group 
of judges). 


Judgments: 


Based upon the standards selected by the group, your individual 
decision as to whether or not each level of the program did or did not 
meet the standards is checked below. 


Antecedents - [_] zs they did meet the standards. 
or 
erixe they did not meet the standards. 


Transactions - [__] vs they did meet the standards. 
or 


[xo they did not meet the standards. 


Outcomes - [| ¥es they did meet the standards. 


or 


[_ ]% they did not meet the standards. 


If you wish to make any additional comments re: the judgments, please 
do so on the back of this page. 
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PSYCHOMOTOR ‘LEARNING MODULE 


Descriptive Matrix: 


Question #1. 


In your opinion was there an adequate logical contingency? 


Rate: (check one) Low [| Med. [| High ie 


Please elaborate: 


Question #2. 


In your opinion was there sufficient congruency? 


Rate: 


(check one) Antecedents Low as, Med. ea High | 
(check one) Transactions Low ea Med. Eg High [| 
(check one) Outcomes Low fa Med. ee High a 


Please elaborate: 


Question #3. 
In your opinion was there an adequate empirical contingency? 


Rate: (check one) Low ie Med. ee High [ 
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PSYCHOMOTOR “LEARNING “MODULE 


Judgment Matrix 
Standards: 


Group concensus as to which of three possible sources of standards 
to select must be attained. The source of standards agreed upon by all 
judges is checked below: 


[| - Pilot Project 
| - Intended Column 


eee | - Those specified on following sheet (developed by this group 
of judges). 


Judgments: 


Based upon the standards selected by the group, your individual 
decision as to whether or not each level of the program did or did not 
meet the standards is checked below. 


Antecedents - [_] es they did meet the standards. 
or 
[|e they did not meet the standards. 


Transactions - [| ves they did meet the standards. 
or 


[.]* they did not meet the standards. 


Outcomes - ape they did meet the standards. 


or 


[| NO they did not meet the standards. 


If you wish to make any additional comments re: the judgments, please 
do so on the back of this page. 
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APPENDIX F 


META - EVALUATION INSTRUMENT 


7 eyes a Es 
TeawrreaT cpr ean - ava 7 


Scientific Criteria: 
Internal Validity 
External Validity 
Reliability 
Objectivity 


Special Criteria: 


Relevance 
Significance 
Scope 
Credibility 
Timeliness 
Pervasiveness 


Efficiency 


META — EVALUATION INSTRUMENT 


: 


Low 


ho 
1e%) 
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The scientific criteria are these: 
Interna] validitv The information provided by 
the evaluation must display a reasonable 
correspondence to the phenomena which it 
purports to describe or interpret. It must 
have fidelity, or, in the layman's sense, it 
must be true. External validity The 
information must be generalizable to Sinilar 
Situations beyond the one in which it was 
collected. Particularistic data have little 
utility. If, for example, data relating to 
the effectiveness of an innovation could not 
be interpreted aS also being valid in 
classrooms other than the ones in which they 
were collected, little would be gained in 
deciding whether to adopt or not. Reliabilty 
Here the concern is with the replicability of 
the data. If a repetition of the evaluation 
did not froduce essentially similar findings, 
we should be concerned that the findings were 
simply random and therefore meaningless. 
Objectivity Here concern is with the 
publicness of the data. If data are private 
in the sense that only particular persons 
would so interpret then, i.e., that not all 
competent judges would agree on then, their 
true meaning is subject to question. 


In addition to these four general 
criteria that could be invoked in relation to 
any infcrmation, certain special criteria of 
practical utility must be met by evaluative 
information. These are: Relevance The 
information must relate to the decisions to 
be made. Significance The information must be 
weighted for its meaning in relation to the 
decision. Not all relevant information is 
equally weighty. The culling and highlighting 
reguired is a professional task that 
justifies the inclusion of a _ treportorial 
expert on the evaluation team. Scope The 
information must relate to all aspects 
involved in the decision. If there are six 
alternatives to be considered, informtion 
that applies to only four lacks scope. 
Credihilty The information must be trusted by 
the decision-maker. 
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Timeliness The informtion 
must come in time to be useful to the 
decision-maker. The evaluator must guard 
against the scientific value that argues 
against publishing findings until every last 
element is in. Late information is vorthless 
information. It is better in the evaluative 
Situation to have reasonably qood information 
on time than perfect information too late. 
of the audiences (tee. tO dai. OL the 
decision-makers) who need it. Efficiency It 
is possible for an evaluation to mushroom out 
of all proportions to its value. The 
imprudent evaluator may produce a mountain of 
information whose collection imposes an 
intolerable financial drain. Proper 
application of the criteria of relevance, 
Significance, and scope should remedy the 
grossest inefficiencies. But even when the 
inforraticn proposed to be collected neets 
all of these criteria, tkere are probably 
still alternative ways for collecting it that 


differ in terms of the time, costs, 
personnel, etc., that are required. The 
criterion of efficiency will guide the 


evaluatcr to the appropriate alternative. 
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